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application  of  manifold  theory  and  geometry  to  mathematical  modeling 
problems  in  depth  vision.  The  second  part  is  an  application  of 
deconvolution  methods  to  the  problem  of  constructing  converging 
sequences  of  approximating  functions  from  sampled  values  of 
convolutions.  The  connection  between  the  two  parts  is  this:  the  first 
part  depends  on  differential  methods;  the  second  part  provides 
converging  algorithms  for  such  methods. 

The  first  part  begins  with  a  model  for  objects.  A  measure  is 
introduced  and  smoothness  is  assumed  almost  everywhere.  The 
radiometric  notion  of  sterance  is  modeled  using  differential  forms  on 
the  sphere  bundle  (of  three  dimensional  Euclidean  space).  It  is  shown 
that  sterance,  even  if  known  on  a  neighborhood  in  the  sphere  bundle, 
does  not  uniquely  determine  the  objects.  However,  sterance  on  a 
neighborhood  can  be  used  to  construct  a  submersion,  hence  to  determine 


codimension  one  submanifolds. 


A  similar  construction  is  carried  out 


for  sterance  given  on  the  sphere  bundle  over  a  curve  (motion  stereo 
with  the  path  known). 
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varying  sterance  on  the  sphere  bxmdle  over  a  point.  We  introduce 
bundles  of  bases,  integral  manifolds,  and  vector  fields  and  one  forms 
with  vanishing  Lie  derivative  with  respect  to  the  position  vector 
field.  We  study  the  flows  of  vector  fields  that  are  Isometries  of  the 
integral  manifolds. 

The  second  part  begins  with  an  analysis  of  deconvolution  methods 
for  convolution  operators  that  are  characteristic  functions  of 
n-dimensional  cubes.  Such  operators  (for  squares)  are  approximations 
of  the  impulse  response  of  photo-detectors  in  vision  systems.  A 
complete  description  for  the  implementation  of  the  method  for  sampled 
data  is  given.  The  primary  accomplishment  is  that  the  error  analysis 
is  presented  with  explicit  error  bounds  throughout. 

The  final  chapter  is  an  analysis  of  the  properties  of  the 
deconvolution  methods  in  the  presence  of  additive  noise.  For  the  class 
of  methods  and  noise  studied  it  is  shown  that  there  is  no  penalty  for 
the  use  of  deconvolution  methods  with  photo-detectors. 
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Introduction 

This  work  is  the  product  of  the  confluence  of  several  technical 
disciplines  at  a  particular  problem  topic.  Each  of  the  disciplines,  as 
well  as  the  problem  topic,  is  well  established.  What  is  unusual  is  the 
drawing  together  of  the  particular  collection  of  disciplines  about  the 
problem.  As  the  title  suggests,  the  blending  is  unfinished:  the  work 
continues  along  two  main  branches  but  has  not  yet  merged. 

The  objective  of  this  introduction  is  to  provide  some  background 
and  rationale  for  our  particular  collection  of  techniques  and  problem 
focus. 

First  the  problem.  The  problem  area  is  vision.  But  this  needs 
both  some  qualification  and  expansion.  (For  emi  introduction  to 
contemporary  issues  and  progress  in  understanding  and  synthesizing 
vision  phenomena  see  Marr  (1982).)  We  are  interested  in  the  subtopic 
of  vision  that  addresses  the  remote  sensing  of  objects  as  subsets  of 
three  dimensional  Euclidean  space.  This  should  be  contrasted  with  the 
subtopics  of  vision  that  are  solely  pattern  recognition,  for  example, 
reading  and  photo-interpretation.  The  subject  of  remote  sensing  of 
objects  really  extends  beyond  vision.  It  includes  such  things  as 
radar,  thermal  sensing,  laser  radar,  sonar,  and  tomography.  In  fact, 
the  problem  area  is  possibly  more  accurately  described  by  the  term 
space  perception.  However,  at  least  in  vision,  the  most  widely 
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recognized  term  is  depth  vision.  As  this  work  addresses  only  vision 
questions,  we  shall  use  this  descriptor.  Collett  and  Harkness  (1982) 
provide  an  excellent  survey  of  the  experimental  knowledge  of  the 
variety  of  depth  vision  phenomena  exhibited  by  animals. 

The  aspect  of  depth  vision  that  is  of  interest  in  this  work  is 
mathematical  modeling  and  the  questions  of  existence  and  uniqueness  of 
solutions  associated  with  the  models.  This  raises  the  question  of  what 
is  a  solution.  It  has  long  been  my  bias  that  any  plausible 
mathematical  model  for  depth  vision  must  have  manifolds  as  solutions. 
Thus,  manifold  theory  and  all  of  the  related  mathematical  techniques 
are  a  primary  element  in  our  collection.  Throughout  this  work  the 
standard  problems  in  which  the  solutions  are  manifolds  were  kept  in 
mind:  submersions,  transversal  intersections,  and  integration  of 
involutive  distributions. 

A  second  element  in  our  collection  of  techniques  is  measure 
theory.  We  use  both  Lebesgue  and  Hausdorff  measure  to  make  precise 
such  Issues  as  edges  and  corners  auid  to  provide  a  weaker  notion  of 
manifold. 

A  related  issue  is  functions.  Smooth  functions  are  generally 
regarded  as  too  nau'row  a  space  for  modeling.  Since  smooth  functions 
and  differentiable  structure  are  essentially  equivalent,  we  must  be 
careful  in  the  choice  of  function  space.  Consequently,  in  everything 
we  do  here  we  understand  that  both  the  manifolds  and  the  functions  are 


smooth  approximations  to  objects  in  a  more  general  space. 


In  other 
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words,  we  are  free  to  use  mollifiers,  i.e. ,  convolution,  as  needed. 

This  point  of  view  is  not  only  mathematically  useful  but  is  also 
fruitful  in  modeling,  for  many  of  the  physical  processes  in  vision  are 
indeed  (approximately)  convolutions.  But  this  raises  the  issue  of 
approximation  and  convergence.  Our  method  to  resolve  this  dilemma  is 
the  use  contemporary  methods  of  deconvolution.  This  topic  is  a  further 
major  element  in  our  collection  of  techniques.  We  use  deconvolution  to 
provide  both  a  theoretical  and  practical  tool  to  obtain  well  defined 
converging  approximating  sequences  for  the  manifolds  and  functions  in 
our  model.  It  is  this  convergence  in  a  suitable  function  space  that 
justifies  our  use  of  differential  methods. 

The  manifold  methods  and  the  deconvolution  methods  are  not  yet 
fully  merged.  As  of  now  the  two  are  developing  along  separate, 
parallel  lines.  Their  individual  progress  is  the  subject  of  this 


document . 


PART  1 


SOME  SOLUTIONS  TO  PROBLEMS  IN  DEPTH  VISION 
FROM  DIFFERENTIAL  GEOMETRY 

1  SOLUTIONS  IN  THE  SPHERE  BUNDLE 

1.1  Objects,  Hausdorff  measure,  and  smooth  almost  everywhere 

In  this  first  section  a  somewhat  technical  issue  is  addressed. 
The  first  goal  is  to  provide  a  sufficiently  careful  mathematical 
description  of  precisely  what  it  is  one  is  attempting  to  solve  for  in  a 
depth  vision  or  visual  perception  problem.  That  is,  in  this  section  an 
answer  is  provided  to  the  questions  of  what  constitutes  a  suitable 
definition  of  "objects"  and  what  are  the  consequent  properties  of  this 
definition.  The  motivation  for  all  of  this  is  contained  in  Theorem  8. 
Theorem  8  may  be  paraphrased  by  saying  that  differential  methods  may  be 
applied  on  an  open,  dense  subset  zuid  that  the  complement  of  the  subset 
has  measure  zero.  Paraphrased  in  terminology  borrowed  from  computer 
vision.  Theorem  8  says  that  all  of  the  so  called  "edges"  and 
discontinuities  are  contained  in  a  closed  set  of  measure  zero. 
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1.  DEFINITION.  An  object  ,4  is  a  compact,  connected  subset  of  R 
that  is  a  topological  3-dimensional  submamifold  with  boundary,  wherein 
the  boundary  dA  contains  an  open  set  U  which  is  a  smooth  2-dimensional 
submanifold,  and  the  2-dimensional  Hausdorff  measure  of  dA-U  is  zero. 

This  definition  is  made,  as  usual,  with  the  objective  of  including 
at  least  those  things  of  interest  while  excluding  as  much  as  possible 
of  all  else.  This  objective  is  illustrated  in  Figure  1.  (In  Figure  1, 
as  well  as  in  others  that  follow,  two  dimensional  figures  are  used  to 
illustrate  higher  dimensions.  )  In  this  definition  the  subset  £/  is  a 
submanifold  in  the  sense  that  (/  is  a  smooth  manifold  with  the  subset 
topology  and  the  inclusion  map  is  an  immersion  (Bishop  and  Goldberg 
1968,  §1.4).  See  the  proof  of  Theorem  8  for  the  definition  of 
Hausdorff  measure  (Federer  1969;  Evans  guid  Gariepy  lecture  notes). 

object  not  objects 


Figure  1 
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1,1  Objects,  Hausdorff  measure,  smooth  almost  everywhere 


It  is  certainly  desirable  to  address  the  possibility  of  more  than 
one  object.  A  v/ay  to  do  this  is  provided  by  the  next  definition. 


2.  DEFINITION.  A  set  of  objects  is  a  finite  collection 
where  N  is  a  positive  integer  and  each  is  an  object,  such  that 

i)  the  interiors  of  the  objects  are  pairwise  disjoint, 

Int  Q  Int  Aj  =  0  for  i  J  , 

ii)  the  union  of  the  intersections,  U  5A  n  9A  ,  and  the 

‘  J  J  ’ 

boundary  of  the  union,  a|^  h^^ve  an  intersection  which  has 

a  2-dimensional  Hausdorff  measure  of  zero. 

We  shall  denote  the  union  of  all  objects  by  A  =  U  A  . 

1 


The  motivation  behind  this  definition  is  illustrated  in  Figure  2. 


Fig.  2.  A  set  of  objects 
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It  is  clear  that  all  of  the  following  are  compact:  A,  dA,  dA^, 

i=l,...,N,  and  U  dA  .  Hence,  3^1  Q  U  I  f)  9i4  closed,  and  it 

has  a  2-dimensional  Hausdorff  measure  of  zero  by  definition.  For  each 


9;!^,  i=l . N,  let  be  the  (relatively)  open  set  in  9^1^  which  is  a 


smooth  submanifold. 


Then 


dA  p)  u|^  j  closed  and  has 


2-dimensional  Hausdorff  measure  zero.  It  follows,  by  deleting  these 
3 

two  closed  (in  (R  )  sets  from  9i4,  that  dA  contains  an  open  set  U  which 

3 

is  a  smooth  2-dimensional  submanifold  of  R  and  dA-U  has  2-dimensional 


Hausdorff  measure  of  zero. 


The  purpose  of  Definition  2  is  not  only  to  permit  the 
consideration  of  more  than  one  object  but  also  to  permit  these  objects 
to  be  in  contact.  In  permiting  contact  it  is  necessary  to  drop  the 
requirement  that  the  boundary  be  a  topological  manifold:  see,  for 
example,  the  two  spheres  in  contact  in  Figure  2.  However,  the  second 
half  of  Definition  1  can  be  retained:  up  to  a  closed  set  of  measure 
zero  the  boundary  is  a  smooth  submanifold.  A  further  remark  on 
Definition  2  is  that  for  many  of  the  situations  that  follow,  the 
finiteness  of  the  collection  could  be  relaxed  to,  say,  countability 
with  finiteness  on  any  compact  region.  Essentially  what  is  needed  is  a 
suitable  analog  for  the  notion  of  o—f initeness  with  respect  to  a 
measure.  This  extra  generality  in  not  pursued  here. 

This  discussion  began  with  the  definition  of  objects  only  because 
it  is  necessary  to  define  what  ultimately  is  to  be  excluded.  Nearly 
all  of  the  analysis  is  performed  on  the  complement  of  the  objects. 


8  1.1  Objects,  Hausdorff  measure,  smooth  almost  everywhere 

3.  DEFINITION.  Empty  space  M  is  the  complement  of  the  union  of 
all  objects, 

M  =  \R^-  A  =  U  . 

i 

3 

Consequently,  M  is  an  open  submanifold  of  R  . 

3 

The  usual  notation  is  used  for  the  following  objects.  TR  and  TM 

3 

are  the  tangent  bundles  of  R  and  M  respectively.  The  bracket  notation 

3 

<,>  is  used  for  the  standard  metric  on  TR  and  TM.  The  sphere  bundles 

3  3 

over  R  and  over  M  are  denoted  by  SR  and  SM  respectively,  these  being 
the  bundles  consisting  of  unit  tangent  vectors.  The  projection  map  of 
a  bundle  to  its  base  is  usually  denoted  by  n,  for  example,  the 
projection  it:SM  — >  H  . 

All  of  the  bundles  above  are  paral lei izable.  For  example,  SM  is 

2 

bundle  equivalent  to  Af  x  S  ,  that  is,  there  exists  a  diffeomorphism 
which  maps  fibers  onto  fibers  and  is  the  identity  on  the  base.  The 
restriction  of  a  bundle  to  a  subset  of  the  base  is  denoted  by  a 

3  3 

subscript.  For  example,  the  restriction  of  SR  to  SA  c  R  is  denoted 

3  3 

by  •  Of  course,  since  M  is  open  =  SM,  and  the  latter 

notation  will  be  used  here. 

A  method  is  needed  for  extending  a  function  (or  section)  from  a 
small  neighborhood  to  some  larger  open  set.  In  this  work  we  tackle  the 
simplest  possible  problem  and  choose  the  simplest  possible  method  of 
extension.  Roughtly  speaking,  we  use  the  model  that  light  travels  in 
straight  lines  in  M.  The  following  definition  and  constructions 
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exploit  this  choice.  They  are  illustrated  in  Figure  3. 

The  convenient  way  to  formalize  the  straight  line  extension  is  to 

use  geodesic  phase  flow  (Sternberg  1983,  199;  Arnold  1980,  App. l.J). 

The  standard  construction  is  the  following  (O’Neill  1983,  67-70). 

First,  the  so  called  natural  covariant  derivative  is  defined  for  vector 
3  3 

fields  on  IR  by  the  condition  that  the  standard  basis  for  TR 
determined  by  the  natural  coordinates  is  parallel.  A  geodesic  is  a 
curve  whose  velocity  vector  field  along  the  curve  is  parallel. 
Geodesics  exist  at  least  locally  sind  are  uniquely  determined  by  the 

3 

initial  velocity  vector.  For  R  a  geodesic,  a  curve  from  an  interval 
in  R  to  R  ,  can  be  extended  to  the  so  called  maximal  geodesic  so  that 
it  is  defined  for  all  of  R.  Also,  the  norm  of  the  velocity  vector  of  a 
geodesic  is  constant  along  the  geodesic.  These  standard  results  are 
exploited  in  the  following  notation. 

3  3 

Let  u  e  SR  .  Let  y  :R  — >  R  be  the  maximal  geodesic  such  that 

U 

*  *  3 

the  initial  velocity  vector  y  (0)  satisfies  y  (0)  =  u  e  SR  . 

u  u 

This  formalism  is  convenient  for  a  number  of  reasons.  First  and 
foremost,  it  provides  a  coordinate  free  represenatation.  Second,  it 

3 

lifts  in  the  appropriate  way  to  paths  in  SR  .  And  third,  by  virtue  of 
this  notation  everything  is  in  place  to  consider  the  problems  discussed 
here  for  more  general,  nonflat  manifolds. 

It  is  now  necessary  to  use  some  less  standard  notation.  Here  the 
relation  between  distance  and  the  parameterization  of  unit  speed 
geodesics  is  exploited  to  define  a  function  on  the  sphere  bundle  over 
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empty  space  M. 

4-.  DEFINITION.  Let  SM  be  the  sphere  bundle  of  IR  restricted  to 
empty  space  M  and  let  IR^  =  -{  teIR  |  t>0}.  Define  t:SM  — >  R^U  {oo> 
by  t(u)  =  sup-f  t  >  0  I  V  s  e  [O.t)  :  e  W  1  . 


We  shall  refer  to  the  function  t  as  the  extent  function.  Note 
that  in  the  definition  of  t  the  geodesic  curve  is  followed  backwards  in 
its  parameter.  This  is  illustrated  in  Figure  3,  where  the  base  point 
of  u  e  SM  is  m,  that  is,  n(u)  =  m,  and  where  only  SR  is  illustrated. 


Figure  3 
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For  purposes  of  notation  the  following  maps  are  defined: 
y:SIR^  X  R  >  R^  ,  3r(u,  t)  =  y  (t)  ; 

U 

V!f:SR^  X  R  >  SR^  ,  ^piu,  t)  =  y  (t)  ; 

U 

V!»^;SR^  - >  SR  ,  tp^(u)  =  \p(.u,  t)  . 

The  map  \p  is  the  so  called  geodesic  phase  flow.  The  map  \p  is 
smooth  since  >fi  is  the  solution  to  a  smooth  ordinary  differential 
equation.  Recall  that  for  t,  t'  €  R,  0[0(u,t)  ,  t''j  =  \p{u,t+t'). 

The  visual  perception  problem  in  which  we  are  interested  may  be 
stated  as  the  problem  of  determining  the  extent  of  empty  space  about  an 
observation  point.  In  terms  of  the  structure  given  above  this  problem 
is  the  determination  of  the  map  i  defined  as  follows. 

5.  DEFINITION.  Let  SW  and  S  R  be  the  sphere  bundle  SR 

0A 

restricted  to  free  space  W  and  to  the  boundary  of  the  union  of  the 

objects  dA,  respectively.  Let  x  be  the  extent  function  and  let 

R  =  {t  >  0}'.  Define 
+ 

$:SW  -  t“^(oo)  - >  S_^R^  X  R  , 

oA  + 

$(u)  =  [  ,  t(u)  ]  . 

The  next  task  is  to  clarify  some  properties  of  the  extent 
function. 


6.  LEMMA.  The  extent  function  x  is  lower  semicontinuous. 
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Proof.  By  definition  t  is  lower  semi continue us  at  u  e  SW  if 


llminf  t(u)  i  t(u  )  . 

o 

U  — »  U 

o 


U  €  SW 

Choose  t  such  that  0<t  <t(u)soo 
o  o  o 


Hence,  for  all  s  e  [0,  t  ], 


y  (.-s)  6  M.  Let  y:SIR  xR 


be  defined  by  y(u,  t)  =  y  (t).  Let  A 

U 


“1  3 

be  the  union  of  all  objects.  By  continuity  y  (A)  is  closed  in  SR  xR, 


while  {u  }x[0,  £  ]  is  compact  and  disjoint  from  For  each  point 


(u  ,s)  e  {u  >x[0,  £  ]  there  exists  an  open  set  £/  c  SR  and  an  e  >  0 

O  O  O  6  S 

such  that  (u  ,s)  €  Lf  x(s-c  ,  s+c  )  c  y~^(M).  Passing  to  a  finite 

o  s  s  s 

subcover  \u  x(s  -e  ,  s  +e  )  ^  of  {u  }x[0,£  ],  we  have,  with  U  = 

sisls  o  o.  o 

t  1  I  1  Jl 


n  U  ,  that  there  exists  t)  >  0  such  that 

*  *  S 

I  1 


{u>x[0,£  ]  c{/x(-t7,£+7))  cUy  x(s  -e  ,s+e  )  c  y~^(M) . 

o  o  o  o  ^  1  1 

Consequently,  for  every  u  e  (/  we  have  t(u)  a  £  +  tj,  hence 


inf  t(u)  s  £  +  T}  and  liminf  t(u)  a  £  +  tj  >  £  .  Since  £  was  an 


uel/ 


u 


u  e  Sff 

arbitrary  positive  number  less  than  t(u  ),  the  result  follows. 

O 


7.  COROLLARY.  is  open  in  SM. 


Proof.  Let  t  be  the  restriction  of  t  to  SAf  n  SB  ,  where  B  is 

n  *  *  n  n 

an  open  ball  of  radius  n,  n=l,2 .  and  SB  =  S_,  R  .  Since  =  U  /I 

no  i 

n  1 

is  compact,  the  image  of  t  Is  contained  in  a  set  (0,K  )U{oo>  ,  for  some 


positive,  finite  K  ,  for  the  finite  values  of  t  are  bounded  by  the 

n  n 


1.1  Objects,  Hausdorff  measure,  smooth  almost  everywhere  13 

diameter  of  B  U  vi  .  Consequently,  t  ^(cd)  =  t  ^({t>K  >)  = 

n  n  n  n 

T"^({t>K  })  n  SB  which  is  relatively  open  in  SH  since  t  is  lower 

n  *  *  n 

semi continuous  and  since  SB  is  open  (Wheeden  and  Zygmund  1977,  Theorem 

n 

4.14).  Hence  t  ^(oo)  =  U  t  ~^(oo)  is  open  in  SM.  m 

n 

n 

The  following  theorem  is  the  primairy  goal  of  this  section.  It 
tells  us  something  about  how  "edges"  of  objects  and  other  troublesome 
sets  on  the  boundary  of  objects  appear  to  an  "observer"  in  SM. 

8.  THEOREM.  Let  the  set  of  objects  be  non-empty.  Then  the 

following  hold. 

i.  The  Interior  of  SM  -  t~^(oo)  is  non-empty. 

ii.  The  interior  of  SM  -  t"^(oo)  contains  an  open  set  ?  on  which  4 

is  a  diffeomorphism  of  S'  with  its  image  in  S„  R  xR  ,  and 

u  A  + 

Z  =  SM  -  T  ^(oo)  -  S  has  measure  zero  in  the  smooth  manifold  SM. 

iii.  Let  S(34  -  Z)  denote  the  sphere  bundle  of  dA  -  Z.  With 

S(34  -  Z)  identified  with  its  inclusion  in  S„  ,R^, 

oA 

z  =  -  z)xrJ  U  [s^r^xrJ]  . 

Proof.  Recall  the  map  «/;:Sr\r  - >  SR^  ,  \p[u,  t)  =  y  it).  We  make 

U 

several  observations. 

Obs.  1  ^  is  a  left  inverse  for  for  0(|4(u)]  =  -t(u)]  ,  t(u)] 

=  ijjiu,0)  =  u  . 


Obs. 2  $  is  one-to-one,  for  it  has  a  left  inverse. 
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Obs.3  For  any  set  S  c  SR^xK,  =  (i/fo*)  ($“^(S) )  c  ^(S)  . 


CLAIM  1.  For  Z  c  SA  c  IR  aind  the  2-dimensional  Hausdorff  measure 

—1  3 

of  Z  zero,  then  $  (S  IR  xR  )  has  measure  zero  as  a  subset  of  the  smooth 

2  + 

manifold  SM. 

Proof  of  Claim  1.  By  Obs.3  is  suffices  to  show  0(S^R^xR^)  has 
measure  zero  . 


The  Hausdorff  measure  is  defined  for  subsets  of  R  .  To  relate 


SR^  X  R  to  R®  let  TR®-{0} 

+ 


=  {' 


V  e  TR  I  <v, v>  * 


“  } 


be 


identified  with  R®  x  (R®-{0})  by  the  usual  identification  using  the 
natural  coordinates  for  R®.  Define  p:TR®—{0>  — 


SR  X  R^  by  /a(v)  = 

r  V  ^  1/2 

tlFvir  ’  ~  <v,v>  .  Then  is  smooth,  hence  locally 

Lipshitz,  on  TR®-{0}. 

The  following  result  is  needed.  For  any  set  A  c  r",  let  H^{k) 
denote  the  s-dimensional  Hausdorff  measure  of  A.  If  }f{k)  =  0,  then, 
for  A  X  R  c  r"  X  R,  x  R)  =0,  0ss<oo  .  To  see  this  it  suffices 


to  consider  s>0,  for  H  is  counting  measure.  By  definition,  for  0<3£oo, 

H^(A)  =  lim  H^CA),  where 
5-K)  ^ 


^3' 


( 

00 

diajnC  ' 

s 

=  inf 

Y  a(s) 

J 

{Cj}  t 

u 

J=1 

2 

^  J 

00  , 

A  c  U  C  ,  diajtiC  -  5  V 
j  =  i  ^  J 


Eind  where  a(s)  is  the  Lebesgue  measure  of  a  ball  with  unit  radius  in 

R°.  Since  H^(k)  2:  0  and  since  H°(A)  increases  as  3  decreases, 

o  o 

Hg(A)  =  0  if  H°(A)  =  0.  Fix  3  <  1/3  and  choose  e  >  0.  Then  there 


1.1  Objects,  Hausdorff  measure,  smooth  almost  everywhere 


15 


exists  sets 


c 


such  that  A  c  U  C  ,  diajnC  <  6  ,  and  such  that 

j=i  ■*  ■’ 


”  fdiajnC 


I 

J=i 


CHS) 


Let 


be  the  intervals 


[k'diajnC^  ,  (k+1) -diamC^] ,  k=0, 1 . k(j),  where  k(j)  e  IN  such  that 

1  £  k(j)'diaitiC  <  1  +  diamC  .  Let  C*'  =  C  x  I*'  .  Then 
J  J  J  J  J 

A  X  [0, 1]  c  U  C  X  [0,  1]  c  U  C  X  l‘‘  =  U  C*'  ,  diamC^  <  2-diamC  s  25, 
J  J  J.k  J.k  ■’  ■'  ^ 


00  k(  j  ) 

and  I  I  a(s+l ) 

J=1  k=0 


diamC 


■V  S  +  l 


j 


<  a(s+l)  ^  [l  +  k(j)]  [diamCj] 


s+l 


J=1 


a(s+l ) 

a(s) 


12C.(. 


J=1 


diaunC 

J 


^  a(s+l)^s+i_ 

2  £  - 2  e  . 

oc(s) 


Thus  ^  [0.1]]  =  0  .  Since  is  countably  subadditive, 

[a  X  U  [0,k]]  =  0  .  This  provides  the  desired  result. 

k 

Apply  the  result  three  times  to  obtain  the  implication  that  if 
H^[Z  n  ^A]  =0  then  fj  3A  x  R^]  =  0,  hence  H^(Z  f]  dA  x  R^-{0>]  =  0. 

But  R^  X  [R^-{0}]  is  the  countable  union  of  compact  sets  and  i//op  is 
locally  Lipshitz.  Let  p  be  a  coordinate  map  associated  with  the  open 
set  V  in  the  5-dimensional  manifold  SR^  (  i.e.,  fi:V  — >  W  c  R^,  W 

open).  Then  poipop  is  locally  Lipshitz,  and  by  subadditivity  and  the 
standard  result  for  Lipshitz  maps 

f|  SA  X  R^-{0>]]  5  fl®[Z  f|  5A  X  R^-{0>]  =  0  . 

5  5  5  5 

Since  H  =  L  on  R  ,  where  L  is  the  usual  Lebesgue  measure,  it  is 
established  that  i/([S^R^  x  R^]  has  measure  zero  in  the  usual  sense  of 
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measure  zero  for  smooth  majiifolds. 

CLAIM  2.  Let  be  the  restriction  of  \J>  to  the  smooth  5-manifolcl 
a 

X  R  .  Let  CP  denote  the  critical  points  of  i{ig.  Then  #  ^(CP) 
has  measure  zero. 

Proof  of  Claim  2.  By  Obs.3  c  tp^iCP)  and  \lig(.CP)  is  the 

set  of  critical  values  of  \p..  By  Sard’s  theorem  (Sternberg  1983,  Ch2 

o 

§3)  \bACP)  has  measure  zero. 

a 

CLAIM  3.  CP  =  S(aA  -  Z)  X  R  ,  where  SCdA  -  Z)  x  R  is  identified 
with  its  inclusion  in  x  IR  • 

Proof  of  Claim  3.  Use  the  natural  coordinates  to  identify 
S^^_zIR^  X  R  with  idA  -  Z)  x  x  R  and  SR^  with  R^  x  S^.  Let 

(a,x,  d):I  - >  idA  -  Z)  x  S  x  R  be  a  curve,  hence,  by  the  coordinate 

representation  of  geodesics  in  R^,  ip^ocit) ,  xit)  ,dit)^  is  identified  with 
[a(£)  +  d(t)x(t)  ,  x(t)]  ,  where  x(t)  is  a  unit  vector  in  R^  for  all 
tel.  The  derivative  of  this  curve  vanishes  if  and  only  if  x(0)  =  0 
and  a(0)  +  d(0)x(0)  =  0.  Hence  x(0)  represents  a  vector  t2ingent  to 
aA  -  Z  and  CP  c  S(aA  -  Z)  x  R  . 

Conversely,  if  (p,x,d)  e  S(aA  -  Z)  x  R,  where  x  =  a(0)  for  a  curve 

a:  I  - >  aA  -  Z  ,  a(0)  =  p,  then  the  curve  [a(-t) ,  x,  t+d^  maps  under  ijj  to 

[a(-t)  +  ( t+d)x  ,  x] ,  which  has  vanishing  derivative  at  t  =  0. 


The  following  result  will  be  needed  in  the  next  claim. 
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Sublemma.  Let  X  and  Y  be  manifolds  of  the  same  dimension.  Let  H 

be  an  open  subset  of  X  and  let  f:H  - >  Y  be  one-to-one  and  continuous. 

Let  g‘.Y  >  X  be  smooth  with  gof  =  id|„  .  Let  Y  be  the  open  subset  of 

y  for  which  g  is  regular.  Then  f"^(y  )  is  open  in  H  and 

O 

f:f~^(y  )  - >  f(f"^(y  ) )  is  a  diffeomorphism. 

o  o 

Proof  of  sublemma.  Let  x  e  f  ^(.Y  )  and  let  f(x)  e  V  c  Y  ,  where 

O  O 

g\y  is  a  diffeomorphism  of  V  with  g{V).  By  continuity  f  ^(7)  is  open. 

Since  f(x)  e  V,  then  x  =  gofix)  e  giV),  or  f  ^(7)  c  giV).  Therefore, 

for  all  X  €  f^^(7),  g\yOf(.x)  =  x  =  g|^og|“^(x),  hence  f[x)  =  g|”^(x) 

“1 

since  gL,  is  one-to-one.  Consequently,  every  x  e  f  (X  )  has  a 
neighborhood  on  which  f  coincides  with  a  local  diffeomorphism,  hence 
the  result. 


CLAIM  4.  Let  RP  be  the  regular  points  of  \Jjg.  Then  $  ^iRP)  is 


open  and  ^{RP) 


^dA  X  is  continuous. 


Proof  of  Claim  4.  Let  $(u^)  =  , -t ( ) ]  ,  t(u^)]  be  a  regular 


Let  7  be  a  neighborhood  of  $(u^)  in 


point  of  ifig  in  IR 

3  3 

Sg^-^K  X  R  in  which  is  a  local  diffeomorphism  with  ^g^V)  c  SR  . 

Shrink  7  so  that  c  SM,  which  is  possible  since 

o 

0-($(u  ))  =  u  e  SM  and  SM  is  open.  Moreover,  ^AV)  c  SM  -  t”^(oo), 
oil  o 

since,  for  any  (v,t)  e  7  c  x  R,  t))  s  t. 

Summarizing,  if  €  $  ^{RP),  then  is  in  some  open  set 

^„(7)  c  SM  -  T  ^(oo)  ,  and  is  a  diffeomorphism  on  7.  It  is  not 

a  O 


necessarily  the  case  for  all  (v, t)  e  7  that  t))  =  t.  However, 

o 
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it  is  claimed  that  there  exists  a  neighborhood  V  about  $(u^)  in  7  for 
which  this  does  hold.  This  suffices  to  prove  the  claim,  for  then  on 
this  neighborhood  «(0g(v,  t) )  =  t ) )  ,  -T(0g(v,t))]  ,  v,  t ) )  j 

=  (v,  t),  that  is,  i(i/ig(v,t))  c  V,  with  open,  hence  i~^(RP)  is 


open  and  on  this  set  $  is  continuous. 


To  find  7  consider  the  open  sets  in  (dA  -  Z)  x  x  IR  of  the  form 

=  [Bge  n  ~  X  ^  X  (r(u^)-2e  ,  T(u^)+2e]  c  5il  -  Z  , 
where  is  a  ball  of  radius  2e  centered  at  7r(4(u^)).  Make  the 

natural  identification  of  (dA  -  Z)  x  x  R  with  x  R  and  choose 

e  sufficiently  small  so  that  7^^  c  7.  Define  7^  similarly  (replace  2e 


by  e  in  all  occurrences).  It  is  claimed  that 


t)  €  7^  I  T(\lfg(v,  t))  *  t 


t)  e  7  TiiJj  iv,  t ) )  s  t 


-c}. 


(•) 


For  let  u  *  ^^(v, t)  and  (v, t)  €  7^  .  By  the  definitions 

[l/»(u,-t)  ,  t]  =  (v,  t)  €  X  R, 

while  (defining  v'  e  S„  .R^  ) 

oA 

[(/»(u, -t(u)  )  ,  t(u))  =  (v',t(u))  e  X.  R  , 

hence 


0[|/»(u,-t(u)  )  ,  T(u)-t)  =  0(v',T(u)-t)  =  V  .  (*•) 

If  t(u)  *  t,  then  (v',t(u))  cannot  be  in  7  ,  for  otherwise,  since 

2C  ^  o 

is  a  diffeomorphism  on  7^  ,  then  xjiAv.t)  =  u  and  0„(v',t(u))  =  u, 

2£  O  O 

hence  (v, t)  =  (v',t(u))  which  is  a  contradiction. 

With  (v, t)  e  7  ,  t(u)  *  t,  and  (v',t(u))  «  7  ,  if  t(u)  £  t-e, 

C  2G 

then  we  are  done.  If  t(u)  >  t-c  ,  since  t  e  (t(u^)-c  ,  t(u^)+c),  then 
for  (v',t(u))  i  7^^  it  is  necessary  that  v'  <£  (.dA  -  Z)]  x  U. 
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But  by  (**)  ,  x(u)-t)  =  V.  That  is,  in  terms  of  the 

identification  of  S„.1R^  with  dA  x  S^,  v'  =  (Tr(v'),w)  e  dA  x  and  v  = 

OA 

(7r(v),w)  e  3j1  X  S^.  Thus  rt(v)  e  while  7r(v' )  <£  .  Then,  again  by 

(*•),  |T(u)-t|  >  c,  which  is  a  contradiction.  This  proves  (*). 

From  (•)  it  follows  that  -Icv,  t)  e  \  T(^g(v,  t))  *  tj-  is  closed, 

for  T  is  lower  semi continuous  by  Lemma  1  and  consequently 

(v,  t)  I — >  Tiipgiv,  t))  -  t  is  lower  semicontinuous.  Since 

«  -|^(v,  t)  €  I  riijjgiv,  t))  *  tj-  ,  there  is  an  open  set  V  about 

$(u^)  in  such  that  t))  =  t  on  V.  This  proves  Claim  4. 

To  complete  the  proof  of  the  theorem,  use  Claim  4  and  the  Sublemma 
for  the  case  f  =  $  ,  H  =  i  Y  =  E  -  ~ 

the  statement  of  the  theorem  S'  =  $  ^(RP).  ■ 

Remarks  on  the  proof:  (see  Figure  4) 

1.  Note  that  7r(^(u, -t(u) )  is  a  point  on  the  "nearest  object"  to 

7r(u)  in  the  direction  corresponding  to  u.  That  is,  the  reason  for 

introducing  t  and  <5  is  to  keep  track  of  so  called  occlusions,  the 


Figure  4 
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situation  in  which  a  geodesic  between  a  point  and  an  object  intersects 
a  second  object.  The  map  iji  does  not  respect  occlusions:  the  path 

ipiuyt)  =  y  (t)  "passes  through"  objects. 

2.  All  of  the  difficulties  in  the  proof  of  Claim  4  are  associated 
with  the  problem  of  occlusions. 

3.  The  set  Z  of  measure  zero  is  made  up  of  the  union  of  the 
"edges"  $  ^(SidA-Z)  x  R)  and  "corners"  $  ^(S^R^  x  R).  These  edges  and 
corners  are  subsets  of  a  5-dimensional  mamifold.  Theorem  10  is  a 
second  version  of  Theorem  8  in  which  the  edges  and  corners  are  subsets 
of  a  more  familiar  2-dimensional  manifold  that  is  the  analog  of  sui 
"image  plane"  in  optical  devices. 

The  following  corollary  describes  the  meuiner  in  which  Theorem  8 
would  typically  be  used  in  applied  problems. 

9.  COROLLARY.  Let  R  be  a  4-dimensional  smooth  submanifold  of  SM 
such  that  for  every  u  e  R  the  curve  y  in  SM  is  not  tangent  to  R.  Then 

U 

R  Z  has  measure  zero  in  the  smooth  manifold  R. 

Proof.  Recall  the  flow  i/i:SR^  x  R  - >  SR^,  tpiu.t)  =  y  it).  Let  E 

U 

denote  the  associated  vector  field  on  SM.  By  hypothesis  E  along  R  is 
nowhere  teuigent  to  R.  Then,  by  the  eu'gument  in  Claim  3  of  Theorem  1,  0 
restricted  to  R  x  R  is  regular.  Choose  a  sufficiently  small 
neighborhood  U  =  iJjiU  x  {0})  c  R  and  a  sufficiently  small  interval 
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(-e,e)  c  IR  such  that  {li{U  x  (-e,e))  is  am  open  set  of  SM.  If  Z  p)  {/  does 
not  have  measure  zero  In  R,  then  x  (-e,e))  cannot  have  measure 

zero  in  SM  (for  choose  coordinates  that  map  through  U  x  (-e,e)  and  use 
the  product  measure  properties  of  Lebesgue  measure).  From  the 
definition  of  Z,  ifjiZrU  x  (-e,e))  =  Z  p)  ipiU  x  (-e,e)),  which  must  have 
measure  zero  by  Theorem  8.  This  is  a  contradiction.  ■ 

The  following  theorem  is  a  third  version  of  Theorem  8.  It  is  the 

analog  of  Theorem  8  for  the  case  of  a  single  fiber  in  SM.  The  notation 

3  3 

is  as  above  (e.g.  ,  A,  M,  'S,  Z).  Here  n:  SIR  — >  IR  is  the  projection  to 

3  3 

the  base  and  7r^:SIR  x  IR  — >  R  is  ti  acting  on  the  first  component  of 
the  product.  This  theorem  is  stated  and  proved  here  for  completeness. 
It  will  not  be  needed  until  Chapter  2  of  this  part.  All  of  the 
remainder  of  this  chapter  depends  only  on  Theorem  8  and  its 
corollaries. 

10. 

i. 

a. 


THEOREM.  Let  A  =  \}  A  be  non-empty.  For  every  m  €  M 
J  ^ 

The  interior  of  n  ^im)  -  x  ^(oo)  is  non-empty; 

The  interior  of  7r~^(jn)  -  x  ^(oo)  contains  am  open  set 
^  PI  ir  ^(di)  on  which  7r^o$  is  a  diffeomorphism  of  ^  pj  n~^[m) 
with  its  image  in  dA,  and  Z  p)  n  ^(m)  =  n~^im)  -  t"^(oo)  -  ^  has 
measure  zero  as  a  subset  of  ir  ^(m); 

Z  n  =  ['(7r^o$)"^(Z)  U  $“^[S(aA  -  Z)  x  R]j  p)  n~^im)  . 


Hi. 
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Proof.  The  proof  parallels  that  of  Theorem  8.  Fix  m  e  M.  Let  ^ 
define  the  section  {oj}  — >  S(R^-{m>)  x  R  defined  by 


• 

f  exp~^(p) 

-1  1 

• 

« 1 

A(p)  = 

M  - li -  • 

II  exp  (p)ll 

,  II  exp  (p)ll 

,  where ,  as 

a 

^  II exp  (p)ll 

m 

m  J 

ID 

■ 

usual,  exp  :T  R^  — >  R^  is  defined  by  exp  (v)  =  y  (1).  Thus 

n  n  m  V 

3  “1 

-{m}  - >  Tt  (m)  is  smooth.  (Note  -0(u,  t)  =  ) 


—1  —1  3 

Let  *  denote  $  restricted  to  ir  (m)  -  x  (oo)  c  S  R  .  Thus 
m  m 

71  0$  (ti)  =  exp  (-t(u)u)  (•) 

1  m  m 

The  three  observations  analogous  to  those  in  the  proof  of 
Theorem  8  car  now  be  made. 

Obs.  1  i//o,a  is  a  left  inverse  for  ir  o*  . 

1  m 

Obs.  2  ir  0$  is  one-to-one. 

1  m 

Obs.  3  For  any  set  S  c  R^-{in},  (n  )”^(S)  c  ^O'&CS)  . 

1  ID 

CLAIM  1.  For  Z  c  dA  c  R^-{in}  and  H^(Z)  =  0,  the  2-dimenslonal 
Hausdorff  measure,  then  (ir  )  ^(Z)  has  measure  zero  in  the 

I  m 

2-dimensional  mainfold  ir"^(m). 

Proof  of  Claim  1.  The  proof  is  a  restatement  of  Claim  1  of 
Theorem  8  with  substituted  for  i/t  and  without  the  need  to  lift  Z  to 
Z  X  R^. 

CLAIM  2.  Let  (^oa)^  and  be  the  restriction  of  and 

respectively,  to  the  smooth  2-manifold  dA  -  Z.  Let  cp  denote  the 
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critical  points  of  (iAoa)„  =  (/»oa  =  iA„oa  .  Then  (ir  o$  )  ^(cp)  has 

a  a  a  a  l  m 

measure  zero  in  the  manifold  tt  ^(m). 

Proof  of  Claim  2.  By  Obs.3  (n  )  ^(cp)  c  (0oa)  (cp).  Apply 

1  m  u 

Sard' s  theorem. 

CLAIM  3.  Let  CP  =  S(dA  -  Z)  x  IR  ,  where  S(aA  -  Z)  x  IR  is 

3 

identified  with  its  inclusion  in  ^  •  Then 

(rt  0$  )"^cp)  =  f  '\CP)  . 

1  m  m 


Proof  of  Claim  3.  Recall  CP  is  the  set  of  critical  points  of  i/»„  . 

o 

By  construction  -a.  is  a  section,  hence  d-a^  *  0  .  Consequently,  if 
p  G  dA  -  Z  is  a  critical  point  of  ,  then  a-Cp)  is  a  critical 

point  of  fpg  .  That  is,  -aCp)  c  CP  .  This  proves  the  first  inclusion  of 
the  following  string  of  inclusions.  The  full  string  proves  the 
claim. 

$"^(A(p))  c  $  "^CP)  =  [<io7r  o$J'^(CP)  =  [tt  [<^"^CP)] 

c  fir  o$  V^Ccp.)  =  9  ”^(a.(cp))  . 

^  1  tOr  Od 

(3)  (4) 

To  see  (2)  note  that  is  defined  to  satisfy,  for  u  e  ti^im), 

<i.ono\p{u,-t)  =  [i/»(u,-t)  ,  -t]  .  Consequently 

•aoTT  0$  =  $  .  (*) 

1  m  m 

To  see  (3)  let  p  e  5A  -  Z  and  p  e  Image  (tt  )  such  that 

1  m 

A(p)  =  (v,  t)  e  S(3A  -  Z)  X  IR  .  Thus,  there  exists  u  e  tt  such  that 
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V  =  0(u,-t(u))  e  S(a>l  -  Z)  ,  7r[i/;(u,-T(u))]  =  p  .  The  curve 

a(t)  =  -T(u)  +  t)J  is  tangent  to  3i4  -  Z  at  t  =  0  ,  a(0)  =  v  ^  0  , 

but  i//o.a.oa(t)  =  u  .  Thus  p  is  a  critical  point  of  . 

To  see  (4)  apply  (•):  for  any  set  S,  if  n  ot  (u)  e  S,  then 

<1071  o$  (u)  =  4  (u)  €  a(S)  . 

1  m  m 

CLAIM  4.  Let  rp  be  the  regular  values  of  (i/io<y)g  .  Then 

(n  o$  )  ^(rp^  is  open  and  tt  o$  :  (tt  o4  )  ^(rp)  - >  dA  -  Z  is 

1  m  1  tn  1  m 

continuous. 

Proof  of  Claim  4.  (Since  this  closely  follows  the  proof  of  Claim 

4,  Theorem  8,  the  presentation  is  condensed.  )  Note  that  the  image  of 

(il)o<^)  is  contained  in  vT^im)  -  t~^(oo)  .  Fix  u  e  tt  ^(m)  -  x  ^(oo)  , 

o 

with  n  0$  (u)  a  regular  value  of  .  Let  7  be  a  neighborhood  in 

1  m  o 

dA  -  Z  about  n  0$  (u)  such  that  (.^047.)  is  regular  on  7.  It  is  claimed 
1  m  O 

that  there  is  a  neighborhood  7  in  7,  with  n  0$  (u)  e  7,  such  that  for 
all  p  e  7,  if  <^ip)  =  iv,t)  ,  then  =  t.  This  suffices,  for 

then  n  o0o.a(p)  =  Tt  (v,  t)  =  p,  hence  n  o#  „(7)]  c  7,  with 

Im  1 

(^^0.0,)  (7)  open  by  regularity,  hence  (ti  0$  )  ^(rp)  is  open  and  on  this 

O  1  m 

set  IT  0$  is  continuous. 

1  m 

To  find  7  let  B  be  the  ball  in  of  radius  2e  centered  at 
2e 

TI  0$  (u).  Choose  e>0  sufficiently  small  so  that 

1  m 

7  =  B  p  (dA  -  Z)  c  7,  and  define  B  and  7  similarly. 

2C  2C  C  C 
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It  is  claimed  that 


|p  e  I  A(p)  =  (v,  t)  .  t[0oa(p)]  *  t| 

c  |p  €  1  -(^(p)  =  (v,  t)  ,  t[i/»oa(p)]  s  t-e|  . 

For  let  u  =  iipoii)  Ap)  and  p  e  V  .  Let  ^(p)  =  (v,  t).  Then 
o  c 

7r^[^;((u,-t)  ,  t]  =  7t^(v,  t)  =  p  e  c  dA  -  Z  , 
Tt^[0(u.-T(u))  .  -t(u)]  =  7r^(v',T(u))  =  7r(v')  e  dA  -  Z  , 

and 


,T(u)-t)]  =  V,  n°\l)(y'  ,riu)-t)  =  3r^,(T(u)-t)  =  p  .  (•) 

If  t(u)  *  t,  then  niv' )  cannot  be  in  for  otherwise,  since 

is  a  diffeomorphism  on  then  0oA(p)  =  \j)oAn[v'))  =  u,  hence 

p  =  7r(v'),  which  is  a  contradiction  of  (»).  But  then,  also  by  (»), 
s  i  nee  p  e  and  it  ( v' )  ^  ,  |T(u)-t|>e. 

By  the  lower  semicontinuity  of  x  it  follows  that 

p  e  I  Ap)  =  (v,  t)  ,  t(i//oa(p)  )  ^  I 

is  closed  and  does  not  contain  (ti  o$  )(u)  ,  hence  there  is  an  open  set 

1  m 

about  71  0$  (u)  in  F  in  which  xfC^O'alCp)]  =  t  and  Ap)  =  (v,  t).  This 
In)  C 

proves  the  claim. 

The  theorem  is  completed  by  applying  Claim  4  to  the  sublemma  in 
the  proof  of  Theorem  1.  ■ 


Why  have  we  bothered  with  Theorems  8  and  10?  Two  of  the  payoffs 
can  now  be  described.  For  brevity  we  shall  refer  to  the  situation 
described  in  Theorem  8  as  the  (SR^.SW)  case,  and  to  that  in  Theorem  10 
as  the  ([R^,S^)  case. 
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The  first  payoff  Is  a  description  of  so  called  "edges.  "  In  the 
engineering  literature  the  notion  of  edge  is  rarely  explicitly  defined 
but  rather  is  described  Intuitively.  Frequently  the  notion  carries  the 
de  facto  definition  of  that  which  the  author’s  edge-finding  algorithm 
finds.  What  is  generally  understood  to  be  an  edge  could  be  defined  as 
follows. 

11.  DEFINITION.  Let  o-  be  a  submersion  from  a  manifold  N  onto  a 
manifold  P.  Let  S  be  a  subset  of  N.  The  boundary  3(<r(S))  of  the  set 
<r(S)  is  called  the  edge,  or  the  set  of  edge  points,  of  (r(S)  in  P. 

In  Definition  11  it  is  to  be  noted  that  S  is  the  only  set  in  N. 
There  is  not  sufficient  geometry  in  the  notion  of  submersion  to  address 
the  case  of  one  set  occluding  another.  This  caui  be  partially  resolved 
by  considering  a  disjoint  union  of  such  S  and  the  corresponding 
boundaries.  However,  the  disjoint  union  includes  all  boundaries  and 
has  no  provision  for  excluding  any.  (Such  an  all  inclusive  projection 
was  used  in  the  proofs  of  Claims  1  and  2  in  Theorem  8.  )  These 
considerations  are,  of  course,  the  motivations  behind  our  definitions 
of  T  EUld  ♦  . 

Let  us  find  the  edges  in  our  two  cases.  For  the  (IR^,S^)  case, 
N  =  \R  -{m} ,  P  =  n  (m),  o*  =  and  the  set  S  is  a  weaker  version  of 
our  definition  of  the  union  of  all  objects  A.  The  additional  structure 
in  our  definition  of  A  provides  additional  information  regarding 
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3  2 

5((r(S))  in  the  case  S  =  >4.  In  particulELT,  for  the  (R  ,S  )  case,  it 
follows  from  Theorem  10  that 

dt<r(S))  =  c  U  SCail  -  Z)  X  Rj  .  (edgl) 

To  see  (edgl)  it  is  necessary  of  first  observe  that  not  only 

in  0$  )  c  but  moreover  (tt  oiI>  =  ijjotiiA)  because  A  is 

1  m  1  m 

3 

the  only  set  in  R  -{m}:  for  every  p  e  A  (tt  0$  o^^o^)(p)  must  be  a 

1  m 

point  in  A  by  the  definition  of  *  .  With  this,  by  Claim  4  of 
Theorem  10,  in  )  ^irp)  is  an  open  set  of  i/to^iA),  hence  is  in  the 

1  n 

interior  of  Consequently,  in  0$  )”^{il-rp)  must  contain  the 

1  CD 

boundary  diij/o^^iA)) . 

The  same  holds  for  the  (SR^.SW)  case,  where  N  =  SR^  x  R  ,  P  .=  SM 

+ 

(or  a  neighborhood  in  SM  or  a  suitable  4-dimensional  submanifold), 
~  ^  ~  ^  '  Then,  as  before,  since  S  is  the 

only  set,  $~^(S)  =  i/»(S)  p|  SM,  and 

a(<r(S))  -  dP  =  a[<jjiS)  f|  SM)  -  dP 

c  $~^j^[s(ail  -  Z)  X  rJ  U  [S^R^  X  Rjj  .  (edg2) 

From  the  inclusions  in  (edgl)  and  (edg2)  we  can  now  conclude  that 
for  either  of  our  cases  the  set  of  edge  points  is  a  set  of  measure 
zero.  We  remark  that  the  inclusions  are  not  equalties  because  our 
objects  may  have  "corners"  (points  of  non-differentiability)  and 
critical  points  which  may  or  may  not  project  to  edge  points. 

As  is  well  known,  a  massive  amount  of  effort  has  gone  into  the 
development  of  algorithms  to  find  the  set  a(cr(S))  in  P.  From  our  point 
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of  view  here,  finding  a(<r(S))  is  a  difficult  task  since  S(<r(S))  has 
measure  zero:  almost  surely,  in  the  sense  of  probability  measure,  any 
point  chosen  at  random  is  not  an  edge  point.  In  fact,  almost  surely 
every  point  is  a  nice  point  in  the  sense  that  it  has  a  neighborhood 
about  it  which  is,  say,  diffeomorphically  related  to  a  neighborhood  in 
some  bundle  over  dA.  That  is,  the  nice  points  constitute  an  open, 
dense  subset,  and  the  complement  of  this  subset  has  measure  zero. 
These  properties  form  the  basis  for  the  application  of  geometric  method 
in  the  remainder  of  this  work. 

The  second  payoff  is  not  that  9  and  9  are  diffeomorphisms  almost 

ID 

everywhere  but  rather  that  their  compositions  with  projections  are 
submersions.  Thus  these  compositions  injectively  pull  back 

differential  forms.  Throughout  the  remainder  of  this  chapter  we  will 
be  considering  only  the  (SR  ,SM)  case.  We  will  return  to  the  (R  ,S  ) 
case  in  the  next  chapter. 

Let  denote  the  projection  p^:SR^  x  R  - >  SR^  ,  and  let 

9  =  p  o9:SM  -  t"^(oo)  — >  .  The  following  is  immediate. 

1  oA 

12.  COROLLARY  (to  THEOREM  8).  There  exist  an  open  set  ^ 
contained  in  the  interior  of  SM  -  t  ^(co)  such  that  SM  -  t  ^(oo)  -  ^  has 
measure  zero  as  a  subset  of  the  smooth  manifold  SM,  and  on  &  the  map 


is  a  submersion. 
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With  this  result  we  can  now  use  differential  forms  to  describe 
some  standEU'd  radiometric  notions  in  optics.  We  first  describe 
sterance.  In  elementary  radiometry  sterance  is  defined  to  be  "the 
radiant  power  emitted  from,  transmitted  through,  or  reflected  off  a 
svirface  per  unit  projected  area  of  that  surface  per  solid  angle" 
( Meyer-Arendt  1984,  383).  We  shall  describe  a  differential  form  that 
corresponds  to  sterance  as  well  as  describe  a  suitable  theory  of 
integration. 

First,  3i4  -  Z  is  orientable,  for,  by  Definition  2  each  connected 

component  of  SA  -  Z  is  an  open  set  in  the  boundary  of  only  one  of  the 

objects  A  (  A  =  U  A  )  ,  and  each  dA  by  Definition  1  is  the  boundary 
J  ,  J  J 


of  an  orientable  manifold  with  boundary.  Also,  is  orientable, 

2  3  2 

for  S  is  orientable  and  is  diffeomorphic  to  SA  -  Z  x  S  . 

In  describing  integration  we  must  use  some  care  since  9A  -  Z  is 
not  compact.  Let  v  denote  a  (global)  volume  element  for 
(O’Neill  1983,  195).  That  is,  v  is  a  smooth  4-form  on  such 

that,  for  any  orthonormal  basis  (e  ,e  ,e  ,e  )  of  T  (S_,  JR  )  , 

1234  V  oA-^ 

v(e  ,e  ,e  ,e  )  =  ±1  .  As  usual,  any  basis  (b  ,b  ,b  ,b  )  is  said  to  be 

1  2  3  4  >  J  2’  3’  4 

positively  oriented  if  u(b  ,b  ,b  ,b  )  >  0  .  A  coordinate  map  h  of  a 

12  3  4 


1  2  3  4, 


coordinate  chart  (17,  h),  U  c  ,  h  =  (x,x,x,x):(/ 


IS 


positively  oriented  if,  for  3  =  -  ,  i=l,--",4,  i;(3  ,3  ,3  ,3  )  >  0  . 

t'  O'  1  „  1  ’  12  3  4 

3x 

For  such  a  coordinate  neighborhood  and  positively  oriented  map  define 


J  y  by 
U 
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U  h(U) 


where  the  integral  on  the  right  is  the  Lebesgue  integral  over  the  open 

(hence  Lebesgue  measurable)  set  h(U)  of  the  smooth  (hence  measurable), 

positive  function  v(d  ,8  ,8  ,8  )<>h~^.  Hence,  the  integral  is  defined, 

12  3  4 

although  it  may  have  the  value  +eo  . 

3 

For  any  open  set  E  c  .  let  (p^  be  a  partition  of  unity 

subordinate  to  the  countable  cover  of  E  by  coordinate  ne i ghborhoofis 
of  an  atlas  with  positively  oriented  coordinate  maps.  For 


u  /  1  2  3  4.  1 

hj  =  (x^,Xj,Xj,Xj),  let 


ax-" 


and  dx  denote  dx  dx  dx  dx 

12  3  4 


We 


propose  to  define  J  u  by 

E 


I  (.,(!/,) 


13.  LEMMA.  For  E  c  ,  X  f  is  well  defined. 


Proof.  (1)  Each  term  in  the  sum  is  finite,  for  each  (p^  is  smooth 

and  compactly  supported  in  h^iU^)  and  v  is  smooth.  Since  all  terms  of 

the  series  are  positive,  all  rearrangements  either  diverge  or  converge 

to  the  same  sum.  Thus  it  suffices  to  consider  the  case  in  which  for  a 

choice  of  {U^,h^}  and  •{^^}  the  series  converges. 

(2)  Let  ^  second  atlas  with  positively  oriented  maps 

12  3  4 

gj  =  ^  partition  of  unity  subordinate  to  the 
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cover  {V  }  .  For  brevity  let  =  <p.  i<PXc^°g^  = 

J  1  £,  i  1  J  £•  j  J 


TT  r  ^  ^  ^  n  r  ^  o  -v  -1 

— . —  .  and  G  =  v[  — . —  )og 

*  On,  fl,*  ‘  J  a,,  * 


dx  dx 

i  1 


since  E  ^  =  E  <Pj  =  1  , 
J  ^  1 


dy^  dy^ 


E  I  =  S  J  [z 

=  E  J 

*  >  J  V.  (11  «T/  ■> 


dx 


h  (G  nF  ) 
1  1  j 


Then, 


^  »  J  ^  (Tt  ^T/  ^ 


=  J  J  • 


where  the  equality  at  (*)  is  due  to  the  rule  for  the  change  of  variable 
and  the  properties  of  differential  forms.  ■ 


Our  definition  holds  as  well  if,  for  an  atlas  ,  E  is  the 

countable  union  U  h  ^(h  (EnG  ))  with  each  h  iErV  )  Lebesgue  measurable. 

i 

For  if  {V^,g^  is  a  second  atlas,  then  :  h^iU^nV ^  is 

smooth,  hence  g^CEnF^)  =  U  (Enl/^nF^)]  is  measurable  if 

each  h^(Ent/^nFj)  =  h^iEnU^)  p|  h^CG^oF^)  is  measurable.  By  second 
countability  it  suffices  to  require  that  E  satisfy  the  following 
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definition. 

14,  DEFINITION.  For  any  set  E  c  ^  said  to  be  locally 

(Lebesgue)  measurable  if  for  any  coordinate  cheu't  (U,h)  of 
h{.ENJ)  is  Lebesgue  measurable. 


We  are  interested  here  in  differential  forms.  Consequently  we  can 

3 

define  integration  of  forms  only  on  the  smooth  manifold  •  We 

3 

could  equally  well  define  integration  on  by  using,  say,  the 

product  measure  x  of  two  2-dimensional  Hausdorff  measures  for 

S.  identified  with  dA  x  as  a  subset  of  x  R^.  With  this  latter 

aA 

3  3 

definition  we  can  neglect  S^R  for  it  has  measure  zero.  On  the 

measure  of  a  subset  E  and  the  integral  Jv  coincide  by  any  of  the  usual 

E 

arguments  that  these  two  definitions  of  area  of  subsets  coincide  on 
their  common  domain  of  definition.  We  will  not  need  the  measure 
theoretic  definition  so  we  merely  make  the  following  definition. 


3  3 

15.  DEFINITION,  For  £  c  S^^R  ,  EnSg^_^  locally  measurable,  we 


define  /u  by  /y  =  f  u 

C*  17  J 


Defintion  15  has  the  following  obvious  extension. 
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16.  DEFINITION.  Let  E  c  locally  measurable.  We 

3 

say  a  function  f  defined  almost  everywhere  on  ErSg^_^  is  locally 
measurable  if  the  inverse  images  of  Borel  sets  are  locally  measurable. 

J""  ■ 


For  f  locally  measurable  and  f  a  0  we  define  Jfy  by  J'fy  - 

E  E 


Note  that  on  the  smooth  manifold  Sg^_2R  all  of  the  usual 

properties  of  Lebegue  integration  of  nonnegative  measurable  functions 

3 

hold.  For  exajnple,  sets  of  measure  zero  in  Le  ignored. 

The  regard  for  orientation  was  not  essential  in  the  preceeding 
defintions.  We  can  neglect  orientation  by  proceding  exactly  as  above 
with  only  one  modification.  (This  is  an  adaptation  of  Sternberg  1983, 
Ch.2,  sec. 3,  Integration  of  densities.)  Let  u  be  a  differential  n-form 
on  an  n-dimensional  manifold  R.  Let  D  be  a  locally  measurable  subset 
of  R.  Let  be  a  partition  of  unity  subordinate  to  a  countable 


cover  of  D  by  coordinate  neighborhoods  of  an  atlas  {U^,h^} 
h  =  (x^...,x")  ,  a,  =  ,  and  dx  =  dxj...dx".,  define 


For 


ij 


dx^ 


f  |w|  =  E  J  . • 

D  ‘ 

The  proof  that  S  |w|  is  well  defined  is  just  a  restatement  of  the  proof 
D 

of  Lemma  13. 

To  integrate  if  w  is  a  smooth  n-form  defined  everywhere  except  on 
a  set  Z  of  measure  zero  in  R  we  proceed  as  in  Definition  15. 
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17.  DEFINITION.  Let  D  be  locally  measurable,  D  c  R  .  If  w  is  a 

smooth  n-form  on  -  Z  with  Z  of  measure  zero,  we  define  J  Iwl  by 

D 

S  \U>\  =  S  \0>\  . 

D  D-Z 

These  preliminaries  are  sufficient  to  complete  the  discussion  of 

—1  3 

sterance.  Recall  the  map  (oo)  - >  ,  ^  =  P  which 

O  A  1 

according  to  Corollary  12  is  a  submersion  on  S  =  SM-t  ^(co)-Z  . 


18.  DEFINITION.  By  the  sterance  on  &  associated  with  the 

3 

differential  4-form  fv  on  ,  f  a  0  euid  v  a  volume  element,  we 

mean  the  differential  4-form  on  ^  defined  by  4'  (fy)  . 


Recall  that  for  any  four  tangent  vectors  X^,X^,X^,X^  in  T  £ 
fX  ,X  ,X  ,X  l(u)  =  fo4-(u)  y  fd4'  X  ,  d*  X  ,  X  ,  X  1 

^123  4-'  ^ul  u2  u3  U4-' 


where  d'i  is  the  differential  of  at  u  e  ^  . 

U 

Since  4^  is  a  submersion  and  y  is  nonveuiishing,  4'  y  is  a 
nonvanishing  4-form  on  ^  . 

The  following  result  is  the  motivation  for  our  discussion  of 
integration. 


.19.  PROPOSTION.  Let  R  be  a  smooth  4-dimensional  submanifold  of 
SM  that  satisfies  the  conditions  in  Corollary  9.  Let  D  be  a  locally 
measurable  subset  of  R  with  D  c  SM-x  ^(oo)  and  with  4'  one-to-one  on  D. 
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Then  DnZ  has  measure  zero  in  i?  and 

r  |'t*(fu)|  =  {  fv  . 

D  9(0) 

Proof.  By  Definition  16  j*  fu  =  \  .In  addition,  the 

9iD)  9iD)r\Sg^_^^ 

2 

unit  teuigent  bundle  SidA-Z)  has  measure  zero  in  the  manifold 

Hence,  J  fu  =  J  ‘  Since  Z  =  u  S(9il-Z] 

9{D)  9(D)r\Sg^_^^-SidA-Z) 

by  Theorem  8,  it  suffices  to  show  J  |^'*(fu)l  =  j  fv  .  This 

D-Z  9(D-Z) 

follows  essentially  from  the  standard  change  of  vai'iable  argument, 
since  is  a  smooth  map  on  D-Z  .  Briefly,  the  set  where  9  (fv)  =  0  on 

D-Z  (that  is,  where  the  4-form  4"  (fv)  euinihilates  the  four  basis 

vectors  of  the  tangent  space  of  D-Z,  or,  equivalently,  where  d9  does 
not  have  full  rank  on  the  tangent  space  of  D-Z)  has  image  under  9  of 
measure  zero  by  Sard’s  theorem.  Thus,  we  can  neglect  this  set  and  its 
image  in  4'(D).  Then,  when  choosing  a  cover  of  the  remaining  open  set 
in  D-Z  by  neighborhoods  of  charts  {U^,h^},  we  may  choose  and  h^ 
such  that  is  one-to-one,  nonsingular,  and  9oh~^(U^)  is  the 

coordinate  neighborhoods  of  a  positively  oriented  chart.  This  has 

4 

reduced  the  problem  to  the  change  of  variables  case  for  IR  .  ■ 

The  requirement  that  the  set  D  satisfy  the  requirements  of 

* 

Corollary  9  can  be  dropped.  It  will  be  seen  later  that  9  (fv)  =  0  on 
the  subset  of  D-Z  where  the  requirements  fail.  Thus  the  image  of  this 
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subset  has  measure  zero  in  ’iiD). 

The  relationship  in  Proposition  19  is  the  basis  for  our  elementary 
model  for  the  physical  process  of  measuring  the  energy  "detected"  at 

3 

the  subset  D  due  to  some  "emission  density"  fv  on  this 

model  there  is  no  time  variable:  all  the  objects  are  assumed 

stationary  ard  fv  has  no  time  dependence.  To  signify  this  situation  we 

shall  say  that  the  sterance  is  stationary.  However,  we  are  free  to 

move  about  in  SH  .  The  measuring  of  energy  at  D  corresponds  to  the 

physical  process  of  integrating  the  power  at  D  over  a  fixed  time 

Interval.  The  measured  value  is  I  '»*  (fy)|  .  In  applications  the 

D 

value  J  is  used  to  estimate  the  4-form  'i* (.fv)  at  some  u  e  D  . 

D 


To  estimate  4'  (fv)  on  all  of  the  receptor  submanifold  R  there  is 

typically  a  covering  of  R  by  sets  D^,  j=l,  .  .  .  ,  and  the  values 

(fu)  I  are  used  to  estimate  'i'  (fv)  at  some  u  e  D  .  In  the  next 

J  J  J 


D 

J 

section  it  will  become  clear  why  a  single  measurement  suffices  to 
estimate  this  vector  (4-form)  in  a  five  dimensional  vector  space 
(A*(T*SM)). 


The  requirement  to  exclude  is  a  nuisance.  To  eliminate 
this  requirement  we  shall  use  the  fact  that  the  compact  set  consisting 
of  the  union  of  all  objects  A  is  contained  in  a  sufficiently  large  open 
ball  B.  The  exterior  of  B,  that  is,  R^-B,  is  added  to  the  set  of  all 
objects.  Then,  since  3  u  R^-B]  =  dA  \j  dB  ,  this  new  boundary  is  once 
again  compact.  Empty  space  M  is  then  reduced  to  Mr\B  .  It  is  easy  to 
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see  from  the  definition  of  t  that  with  this  augmented  set  of  objects 
T~^(oo)  r\  M  n  B  =  0  ,  for  the  geodesics  cannot  escape  B.  Finally,  we 
assume  that  fv  is  redefined  .  so  that  its  domain  is  increased  to 

^{aA-z)\jdB^  ■ 

To  conclude  this  section  we  now  formulate  the  problem  that  will  be 
the  subject  of  the  remainder  of  this  chapter. 

Define,  for  m  e  M  (i.e.,  for  m  e  MnB), 

t(u))  j-  . 

That  is,  Gim)  is  the  subset  of  M  that  can  be  reached  from  m  by 
geodesics. 

PROBLEM.  When  is  G(m)  uniquely  determined  by  the  germ  of  the 
differential  form  at  m  ? 

That  is,  if  we  know  'I'  ifv]  throughout  a  small  neighborhood  U  in 

SW,  m  e  U,  then  what  can  be  said  about  G(m),  in  particular,  what  can  be 

said  about  the  boundary  of  G(di)?  In  this  problem  statement  we  have 

been  extremely  generous  in  comparison  to  what  is  usually  assumed  to  be 

known  in  various  depth  vision  problems.  We  briefly  list  what  would  be 

given  in  the  three  standard  methods.  In  motion  stereo  with  observer 

motion  it  would  be  assumed  that  ^  (fv)  is  known  along  n  (a(I)),  where 

n  is  the  projection  tt:  SW  >  M  amd  a(I)  is  the  path  of  a  curve 

a:  I  — >  M  .  In  binocular  stereo  it  would  be  assumed  that  (fr)  is 

known  at  ti  )  and  at  n^im  ),  where  m  and  m  are  two  distinct 
1  2  12 

points  in  M.  And  in  accommodation  (depth  from  focus),  it  would  be 
assumed  that  a  2-form  is  known  along  a  path  in  W,  where  the  2-form  is 


G(m) 


t) 


u  e  S  R" 


t  e  [0, 


38 


1.1  Objects,  Hausdorff  measure,  smooth  almost  everywhere 


obtained  by  integrating  the  4-form  over  a  neighborhood  in  each  fiber. 

It  is  clear,  then,  that  the  solutions  we  find  to  the  problem  in 
which  4*  (fv)  is  known  over  a  neighborhood  must  be  solutions  to  any  of 


the  three  standard  methods. 


1.2  Nonuniqueness  in  general 
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1.2  Nonuniqueness  in  general 

The  first  part  of  this  section  is  devoted  to  checking  that  the 
preceding  definitions  and  results  su'e  adequate  to  prove  several 
elementary  items.  With  these  items  it  is  shovm  that  even  if  'S  (fi>)  is 
given  on  a  neighborhood  about  a  point  u  e  SM,  then  G(m),  the  image  of 
geodesic  paths  in  M  from  m,  is  not  uniquely  determined.  In  this 

section  the  convention  is  continued  that  x  ^(oo)  =  0  and  that  M  =  NnB 
for  some  open  ball  B. 

3 

Since  5^4  -  Z  is  a  submanifold  of  R  ,  it  has  a  normal  bundle  which 

3 

is  a  subbundle  of  ^  .  Since  dA  -  Z  has  codimension  one  and  is 

orientable,  it  has  a  unit  normal  vector  field  N.  The  field  N  may  be 

3 

viewed  as  a  section  of  the  bundle  •  We  shall  use  the  bracket 

<,>  to  denote  the  standard  Riemannian  metric  tensor  (that  is,  the 

3  3  3 

standard  inner  product  of  (R  applied  to  T  IR  ,  p  €  IR  »  identified  with 

p 

3 

R  by  the  natural  isomorphism).  The  corresponding  norm  is  denoted 
llvll  = 


20.  LEMMA.  Let  W  be  a  unit  normal  field  on  8 A  -  Z.  Then 
<^(u) , (Wono^) (u)>  ^  0  ,  u  e  SH  -  Z  . 

Proof.  From  Theorem  8  and  the  definition  of  =  p  0$  it  follows 
that  2  D  <il~^{'E>{aA-Z)).  Hence,  SAf-Z  c  [S^^_2lR^  -  S(5^-Z)],  which 
implies  ^'(SW-Z)  c  -  S(5i4-Z).  ■ 
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The  following  definitions  aj*e  standard  ones.  Let  s  ,s  ,s  denote 

12  3 

the  standard  coordinate  functions  of  R  ;  that  is,  s  (.a  ,  a  ,  a  )  =  a  . 

’112  3  1 

3 

Let  u  denote  the  volume  element  u,  =  ds  Ads  Ads  of  R  . 

0  0  12  3 

3 

To  similarly  express  a  volume  element  for  SR  we  shall  use 

3 

interior  multiplication  and  a  volume  element  for  TR  .  In  particular, 


for  TR^  the 

so  called 

natural 

coordinate 

functions 

are 

x,x,x,y,y,y, 

1  2  3  12  3 

where  x  = 
i 

s  071  and  y 

1  -^1 

=  ds  ,  i=l, 
1 

,2,3,  with 

ir  the 

natural  projection 

of  TR^.  A 

volume  form 

for  TR^  is  then  p  Ap  , 

where 

/LI  =  dx  Adx  Adx  =  n  n  ,  and  /i  =  dy  Ady  Ady  . 

1  123  0  2  123 

3 

A  vector  in  T(TR  )  is  called  vertical  if  it  lies  in  the  span  of 


d  a 

^y2’ 

a  a 
ax  ’  ax  • 

2  3 


and  it  is  called  horizontal  if  it  lies  in  the  span  of 

3 

Let  the  metric  tensor  for  TR  be  defined  by 


sy  ’ay  ax  ’ax  as  ’as  u  ’ 

I  j  1  j  I  j 


•'l  J 


i. J=1.2,3. 


Then  u  au  is  a  volume  element. 
^1  ^2 


Let  F  denote  the  vertical  vector  field 

a 


V  €  TR 


I 

Note  that  if  llvll  =  1  ,  that  is,  v  e  SR^,  then  IIF(v)ll  =  1  . 

A  p-form  (as  an  alternating  multilinear  map)  is  said  to  be 
vertical  (horizontal)  if  it  vanishes  whenever  any  of  the  p  vectors  in 
the  argument  is  horizontal  (vertical).  Thus  dx^  and  are  horizontal 
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forms,  dx  Ady  is  neither  horizontal  nor  vertical. 

Let  the  interior  multiplication  of  a  p-form  w  by  a  vector  field  X 
be  denoted  by  Xlw  .  That  is,  X|ta(X,...,X  )  =  w(X,  X,...,X  ).  It 

p-1  1  p-1 

follows  that  is  ^  vertical  2-form  on  TR^  .  If  the  inclusion  of 

SR^  in  TR^  is  denoted  by  t:SR^  ^ - >  TR^  ,  then  ^  vertical 

3  #  3 

2-form  on  SR  and  t  u.  is  a  horizontal  3-form  on  SR  .  It  is 

1 

straightforward,  then,  that 

3 

is  a  volume  element  for  SR  . 

3 

In  a  similar  fashion  the  volume  element  i>  for  S^^  ^  can  be 
expressed  in  terms  of  vertical  and  horizontal  forms.  As  above,  the 
inclusion  maps  are  used  to  pull  back  appropriate  forms.  For  example, 
let  0  be  the  bundle  inclusion  map 


TR 


and  similarly  (the  subscript  1  to  distinguish  the  unit  vector  bundle) 


-4  SR' 


Let  0^  denote  the  adjoint  of  0  (e.g. ,  (0'^dx^)(X)  =  dx^(eX),  X  e 

'^dA-^  ).  Let  N  be  the  previously  defined  unit  normal  vector  field  on 
dA  -  Z.  Then  Wj0^p^  is  a  volume  element  for  dA  -  Z,  where,  as  before, 
we  suppress  the  inclusions  T(dA  -  Z)  in  a-nd  S(SA  -  Z)  in 

^dA-^^'  projection  - >  dA  -  Z,  =  7r*(JVj0Vg) 

is  a  horizontal  2-form  on  •  A  vertical  2-form  is  0^*t*(Fjp^)  . 

From  the  definition  of  N,  F,  p^,  and  p^  it  follows  that,  up  to  sign, 

V  =  y^A0^  f  (Fjp^)  . 
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There  is  one  additional  4-form  that  is  needed.  Let  E  denote  the 

3 

horizontal  vector  field  on  TR  defined  by 

£:TR^  - >  T(TR^) 

£(vl  =  [  . 

1  V 
i 

Then  is  a  horizontal  2-form  on  TR^  ,  is  a  4-form, 

and,  with  the  inclusion  f:SR^  ^ - >  TR^  , 

<r  =  t*  [(£j)j^)A(£jfi^)]  is  a  4-form  on  SR^. 

The  following  simple  calculation  shows  cr  =  t*  [(£aF) J  (p^Ap^)]  ; 

£j  [p^aCFJp^)]  =  (£Jp^)a(FJm2)  +  (-l)='M^A[£j(FjfX2)]  , 

while  the  last  term  vanishes  since  is  vertical;  by  the  same 

reasoning 

FjC/i^Afx^)  =  0  +  (-D^fz^AiFjfi^)  ; 

hence 

(£Jp^)a(FJp^)  =  -Ej[Fj(PjAp^))  , 
and  the  right  hand  side  is  (£aF)J  (jn^A^i^) . 

3 

The  results  we  seek  for  SR  depend,  of  course,  on  the  structure  of 

3 

TR  .  The  following  result  is  elementary,  but  it  provides  a  technical 

3  3 

relationship  between  SR  and  TR  that  will  be  used  repeatedly  in 
proofs.  Recall  the  definition  of  0^(u)  =  ^(u,  t)  =  7^it)  for  u  e  SR^, 
t  e  R,  and  where  y  is  the  geodesic  determined  by  u  . 

21.  LEMMA. 

i.  The  horizontal  vector  field  £: TR^  - >  T(TR^)  is  complete  and 

the  one  parameter  group  of  diffeomorphisms  0^,  t  e  R,  of  £  is  the 
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geodesic  phase  flow,  <(>  (v)  =  r(t).telR,  veTR  . 

t  V 

3  3 

ii.  Let  t:SR  ^ — >  TR  be  the  inclusion  map,  hence  £ot  is  the 

3  3 

restriction  of  £  to  SR  .  Then  there  is  a  vector  field  £  on  SR  such 

1 

that  dt  £^  =  E°i  .  The  one  parameter  group  of  diffeomorphisms  of  £^  is 

3 

that  is,  restricted  to  SR  .  In  summary,  the  following  diagram 
commutes. 


T(SR^) 

eT 


1 


SR 


3 


di 


t 


^  T(TR^) 
£ 

TR^ 


0 


t 


>1/ 


SR 


3 


TR 


Proof,  For  fixed  v  e  TR^  the  images  of  v  and  £(v)  e  T(TR^)  under 
the  standard  coordinate  functions  are 

3  3 

V  I - >  (x  ,x  ,x  ,y  ,y  ,y  )(v)  e  R  x  R  , 

1  2  3  1  2  3 

£(v)  I - >  [(x^,x^,x^,y^,y2,yg)(v)  ,  (y^,  y^,  y3)  ( v)  ,  (0,0,0)} 

e  (r^xR^)x(r\r^)  , 

hence  6  (v)  i - >  (x  +ty  ,  x  +ty  ,  x  +ty  ,  y  ,  y  ,  y  )  ( v)  .  On  the  other  hand 

1  1  2  ■’z  3  '^3  ■'i  ■'a  -^3 

y  (t)  I - >  {x  +ty  ,  X  +ty  ,  X  +ty  ]  ,  hence  y  (t)  =  dt  iv)  .  This  proves 

u  112233  u  t 

i.,  while  ii.  follows  from  the  coordinate  representations  and  the  fact 
that  V  €  SR^  if  and  only  if  Z  y  (v)^  =  1  .  ■ 

i 

With  this  lemma  we  can  now  say  something  about  the  4-form 
O'  =  t  (  (£aF) J  )  defined  everywhere  on  SR  and  about  the  4-form 
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^  (fv)  (sterance)  defined  on  SM-2.  In  the  following  we  do  not  require 
that  M  =  WnB  for  some  open  ball  B. 

22.  PROPOSITION. 
i.  O'  =  <r  ,  telR. 

ii.  Fix  u^  e  SM  .  For  every  t  e  ,  t(u^)] 

a)  there  exists  a  neighborhood  about  such  that  for  all 
u  e  ,  t(u)  =  00  if  and  only  if  r{\p^(u))  =  oo  ; 

b)  if  t(u^)  *  00  and  Z,  then  there  exists  a  neighborhood 

about  such  that  for  all  u  e  =  4'(u)  ;  in  panticulan, 

3 

for  any  p-form  v  on  • 

=  'i!*v  almost  everywhere  on  . 

Proof,  From  the  diagram  of  Lemma  21 

\p  *a'=  ^  *t*(  (£aF)J  (u  AU  ) )  =  1*0  *(  (£aF)J  (p  Ap  ) )  . 

Let  X  ,X  ,X  ,X  be  vector  fields  on  TR^  .  Then 

1  2  3’  4 

</>*  ( (  £a£)  J  ( P^AP^ ) )  ( ,  X^,  Xg.  XJ  = 

p  Ap  ( £,  F,  d0  X  ,  d0  X  ,  d0  X  ,  d0  X  ) . 

12  tl  t2  to  t4 

But  =  E  since  0^  is  the  one  parameter  group  of  diffeomorphisms  for 

£.  Moreover,  from  the  standard  coordinates,  the  matrix  for  d<p^  is 

I  tl 

[d0  ]  = 

0  I 

where  I  is  the  3x3  identity  matrix.  Thus  d0^F  =  tE  +  F.  Hence  F  = 
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d(l>^F  -  tE  =  d<t>^F  -  td<p^E  ,  consequently  EaF  =  d^^(£AF).  Therefore 
F,  d<l,^x^,d^x^,  d<px^,  d4,x^) 

=  #/(M,a4^)(£,F,X,X^,X3.XJ. 

But  (p  (/i  A|i  )  =  det[d<^  l/J  A|i  =  ((1  Afx  )  .  This  proves  i. 
t>X2  t>X2  12 

For  ii.,  for  t  6  R,  u  e  SR^,  then  if  u  e  SW  and  if  t  e 

[-t(-u)  ,  t(u)]  ,  it  follows  from  the  definition  of  t  that  e  SM  and 

t(i/>^(u))  =  t  +  t(u)  .  (») 

The  result  follows  since  t”^(oo)  is  open  by  Corollary  7.  If  t(u^)  5^  oo 

and  u  «S  Z,  then  u  is  in  the  open  set  ^  =  SM-t”^(oo)-Z,  as  is  each 
1  1 

tp^iu^),  t  €  [-t(-u^)  ,  t(u^)]  .  Then 

nip^(u))  ^{}P^iu)  ,  -xiiP^iu))) 

^=°"  tp{u  ,  t-T(^^(u))]  *  =  ^  ^(u,-t(u))  =  4'(u)  . 


The  following  result  completes  the  story  on  the  relationship 
between  the  two  4-forms.  Here  we  readopt  the  convention  that 

—1  3 

T  (oo)  =  0.  Since  (r  is  defined  on  SR  while  4'  y  is  defined  only  on 

3 

SM-Z,  we  use  the  inclusion  J:SM-Z  ^ - >  SR  to  help  keep  things  sorted 


out. 
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23.  THEOREM.  There  exists  a  function  h:SM-Z  - >  R  such  that 

^  V  =  hj  O'  . 

In  particular,  for  u  e  SM-Z,  h(u)  =  <4'(u)  ,  (Woiro4')  (u)>  ^  ,  where  N  is 
the  unit  normal  field  on  dA  -  Z. 

Proof.  The  following  diagrajn  summarizes  the  notation. 


The  vector  field  £'  on  the  open  submanifold  SM-Z  of  SR^  is  induced  by 
the  inclusion  J  .  We  claim 

=  0  . 

3 

For  consider  any  function  f  on  ■  By  Lemma  21,  for  u  e  SM-Z, 

(;d'K£p(f)](u)  =  [r(fo<P)](u)  =  ^  ^_^(fo'J-)(^pu))  . 

But  by  Proposition  22  ’iiili^iu)  =  "Ku)  for  all  t  in  some  small 
neighborhood  about  t=0,  hence  the  claim. 

It  follows  from  the  claim  that  £p(^'  v)  =  0.  Locally  consider  any 
1-form  e*  such  that  e*(£p  *  0.  Then  £p(e*A^*y)  =  .  Since 

Hk  4(41 

u  is  a  nonvanishing  4-form,  e  A’i'  i;  is  a  nonvanishing  5-form  on  SM-Z, 
hence  there  exists  a  nonvanishing  function  k  on  SM-Z  for  which 
e  V  =  kj  n  ,  where  /i  is  the  volume  form  t  (Fj(/i^Ap^))  on  SR  . 
Collecting  nonvanishing  functions,  we  have  that  globally  there  exists 
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h:SM-2  - >  R  such  that  4^1;  =  h£'Jj  n  .  From  the  diagram  above,  from 

the  expression  for  p,  and  from  the  definition  of  o-,  it  follows  that 

4'*i>  =  [(£aF)J  =  hj*(r  . 

To  evaluate  h,  fix  u  e  SM-2  and  let  t  =  r(u  ).  Choose  U  c  SM-2 

0  0  0 

3 

and  p^(F)  x  I  c  ^  IR  such  that  u^e  U  and  on  U  the  map  $  is  a 

diffeomorphism  onto  p  iV)  x  I  .  Thus  t  el.  The  map  is  defined 

^0 

by  the  following  commuting  diagram. 


Hence  =  id|  (yi  »  locally  =  v  .  Consequently, 

V  =  ]*(hj*(r)  =  hoi/r'  oe^)*<r  = 

0  '^o  ^0 

hoth'  Q* xp*  0*  =  ho0'  0*0-  ,  (•) 

0  0  0 

where  the  last  equation  is  by  Propostion  22.  Since 

e*(r  =  0^*i*(£jp^)  A  0^*t*(£jp^)  , 

V  =  7r*(Afj0Vg)  A  0^*t*(Fjp^)  , 

it  suffice  to  compare  0^*t*(£jp^)  and  7r*(iVj0*^|j^)  .  Let  and  be 

3 

any  vector  fields  on  S„ ,  JR  such  that  v  =  dnX  and  v  =  dnX  are 

dA-Z  1122 

orthonormal  at  ^'(u  ).  From  the  diagram  and  the  definitions,  at  'iiu  ) 

0  0 


7r*(iVj0V,)CX  .Xj  =  1  . 
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On  the  other  hand,  since  =  n  and  dn(E)  =  identity, 

(u  is  the  volume  element  of  R^,  <o0  is  the  inclusion  S.  .  — >  TR^) 

0  1  dA-z 

Use  these  last  two  results  to  evaluate  (*)  at  noting  that 


u 


and 


h(u^)  m^[4-(u^),v^,vJ 


h(u  )<'if(u  )  fNono'iiu  )>  . 
0  0  0 


Hereafter  we  shall  assume  that  the  function  f  that  appears  in  the 
4-form  fv  is  a  smooth  function  on  , 

The  following  theorem  is  the  nonuniqueness  result. 


24-.  THEOREM.  Let  u^  €  SM-Z,  n(u^)  =  m  (n  the  projection  SR^ > 

R),  and  let  b  be  a  ball  centered  at  m  such  that  b  c  M  .  Let 

in  m 

U  =  n  ^(b^)p)[SW-Z] .  Let  |  t  e  R>  be  the  one  parameter  group  of 

diffeomorphisms  of  the  vector  field  E  on  SR^.  Then  g  =  U  i/»  ({/)  is 

^  teR 

3 

open  in  SR  and 

i.  There  exists  a  smooth  function  g:6  — >  R  such  that,  in  terms 
of  the  following  inclusion  maps 

i^j-.U  - >  g  ,  ig:g  - >  SR^  , 

- >  SH-Z  ,  J-.Sn-Z  - >  SR^  , 

gig*<r  is  a  differential  4-form  on  §  for  which 

=  ijigi^^r)  , 

where  'i-.SM-Z  - >  defined  for  a  fixed  choice  of  a  set  of 

objects  A  =  [J  A^  . 
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11. 


Let  B  be  any  open  ball  centered  at  m  such  that  b  c  B 

n  mm 


Let 


be  the  volume  element  of 

m 


Let  the  single  set  R  -B 


constitute  a  second  choice  for  a  set  of  objects  {A'}  =  {R-S}, 

J  m 

A'  =  R^-B  ,  dA'  =  a(R^-B  )=  dB  .  Let  v  be  the  volume  element  of 

in  m  m  B 


S„_  R  .  Let  4*  :SB 

oB  B  m 

m 


Sgg  R  be  the  map  for  this  set  of  objects  that 


corresponds  to  4'  above.  Let  be  the  inclusion  U  ^ - >  SB  .  Then 

Un  m 


there  exists  a  smooth  function  f  :S„_R 

B  dB 
m 


IR  such  that 


*  •* . 


Proof:  By  Theorem  23  and  since  J°Jjj  =  > 

(.hoj^)  (igoi^)*  <r  .  (*) 

Define  g: 8  — >  R  by 

g[(/(^(u)]  =  [f o’I'ojg]  (u)  [hoj^](u)  for  all  u  e  {/  . 

That  this  definition  does  not  depend  on  the  choice  of  u  and  t  in 

follows  from  the  facts  a>  if  u  ,  u  e.  U  ,  \b  {u  )  =  ijj  (u  ),  then  u  = 

12  1  2  1 
1  2 

ijj  (u  )  ;  b)  =  ^'  as  in  Propostion  22;  c)  hoi/»  =  h  by  the 

formula  for  h  in  Theorem  23;  and  n{U)  is  a  ball  (convex)  contained  in 
M.  If  we  restrict  g  to  £/  we  have 

goiy  =  [hojy]  , 

and  this  used  in  (»)  proves  i. 

To  prove  11.  first  note  that  'i  is  regular  on  all  of  SB  .  That 

B  m 

3 

is,  the  set  Z  for  R  -B  that  corresponds  to  Z  for  {A  }  is  empty,  for 

B  m  j 

dB  is  smooth  everywhere  and  4'  ^(S(dB  ))  =0.  Thus  n  ^ib  )  c  SB  , 

m  B  m  mm 
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hence  U  c  SB  and  the  Inclusion  j, is  well  defined.  Define  f  to  be 
m  Ud  B 

zero  on  .  It  follows  from  Corollary  9  (to  Theorem  8)  that 

3 

this  set  has  measure  zero  in  S„_  R  .  Otherwise  define 

od 


where  is  given  by  an  application  of  Theorem  23  and  [h^ojyg](u)  *  0 
by  Lemma  20. 

From  i.  for  the  object  {yi  >  we  have  =  i  *(gi  *<r)  and 

J  U  U  b> 

g[0^(u)]  =  [fo^oj^](u)  [hoj^](u)  . 

Repeating  this  for  the  object  R^-B  we  have  *if  v  )  =  i,*(g  ij*<r) 

m  I/BBBB  t/  B6 

and 


But  this  implies  g  =  g  , 

B 


hence  the  result.  ■ 


Theorem  24  says  that  the  objects  are,  in  effect,  irrelevant.  The 

Hi 

4-form  4'  (fy)  could  equally  as  well  have  been  defined  almost  everywhere 
by  using  the  boundary  of  a  sufficiently  large  ball.  The  following 
immediate  corollaries  summarize  more  precisely  some  observations  about 
Theorem  24. 


25.  COROLLARIES  TO  THEOREM  24. 

(1)  A  function  g  defined  on  U  c  SM-Z  such  that  goip  is 


differentiable  a  t  =  0  and  ^ 

at 


(u)  =  0  for  all  u  e  U  determines 


a  function  g  on  &iU)  =U^(1/),  hence  a  4-form  on  &,  gi^  <r. 

teR  ® 
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(2)  For  g  as  in  (1)  and  for  a  ball  B  6  such  that  tt  ^(B)  o  U, 

there  exists  f  iS-^R^  — >  R  such  that  ^  -  ^rr*  • 

B  da  l/B  B  B  B  U  B  & 

m 

(3)  The  choice  of  the  ball  (the  extra  object)  that  made 
t"^(oo)  =  0  is  arbitrary. 
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1.3  A  Lambertian  submersion 

In  the  last  section  we  saw  that  Einy  given  4'  (fy)  on  a  neighborhood 
could  arise,  up  to  a  set  of  measure  zero,  from  essentially  any  set  of 
objects.  This  result  depended  essentially  on  the  fact  that  gig  <r 
coincides  with  the  extension  to  g  of  4*  (fv)  determined  by  0^,  t  e  R. 
The  4-form  4'  (fv)  depends  explicitly  on  an  assumed  set  of  objects  while 
gig  <r  does  not.  In  this  section  we  shift  our  attention  to  gig  <r  . 

3 

We  begin  by  assuming  we  are  given  an  open  set  W  c  SR  that 
satisfies  the  following  conditions.  Let  be  the  previously  defined 

3 

horizontal  field  on  SR  and  let  {\ji  }  .  „  he  the  one  parameter  group  of 
diffeomorphisms  of  E^.  (Recall  0^{u)  =  y^(t)  for  u  e  SR  .  )  We  require 
that  W  be  convex  with  respect  to  •{0^}:  if  u  6  W  and  if  for  some  t'  e  R 
^^,(u)  €  W,  then,  for  all  t  e  [0,t'],  0^(u)  e  W.  (We  can  equivalently 
require  that,  for  every  u  e  W,  (j  )~^(W)  is  connected.  ) 

3 

Further,  we  are  given  a  closed  set  Z  c  SR  of  measure  zero  which 
satisfies,  for  U  =  W-Z, 

W  Q  tuel/,  teRj-cl/. 

In  addition  we  require  that  for  every  m  e  ii(W),  n~^(m)r\WnZ  has  measure 
zero  as  a  subset  of  the  submanifold  ir~^(in). 

As  discussed  in  Section  2,  the  action  of  0^  generates  sets  for 
which  the  features  above  are  preserved. 

g(W)  =  U  0  (W)  , 

teR 
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g({/)  =  U  0  (y)  =  g  . 
teR 

&(Z)  =  U  0  (Z)  . 
teR 

In  addition  to  I/,  U,  and  Z  we  are  given  a  map  g\y-U  — >  R  .  That 
is,  g\^  is  defined  almost  everywhere  in  V.  Further,  for  each  t  such 
that  0^  is  a  local  diffeomorphism  from  an  open  subset  of  U  into  U, 
gly°0^  =  ■  As  in  Section  2,  g\^  then  has  a  unique 

extension  to  S(U)  which  is  invariant  under  0^  for  all  t  e  R  and  which 
coincides  with  g\ ^  on  U.  We  denote  the  extension  by  g. 

As  in  Section  2,  with  such  a  U,  Z,  amd  g  we  define  a  4-form  by 
ij^igi^*<r)  ,  o-  =  t*[(£AF)J(fi^Afi^)]  , 
with  the  inclusion  maps 

i^:U  c - >  §  =  g(£/)  ,  g  c - ^  SR^  , 

<:SR^  « - >  TR^  . 

And  gig  <r  is  a  4-form  on  &  with  0^  ~  •  t  e  R  . 

We  assume  g  is  smooth  on  U. 

We  can  prove  that  both  <r  and  gig  <r  are  closed.  We  omit  the  proof 
for  we  have  no  need  for  the  result.  This  result  is  the  key  element  in 
the  classical  discussions  of  the  energy  entering  and  leaving  a 
neighborhood. 


For  the  next  several  definitions  we  assume  once  again  a  fixed  set 


of  objects.  Suppose  i^  (gig  <r)  =  'i  (fv)  ,  with  fv  a  4-form  on 


^dA-:^ 


3  3 

Let  71  denote  the  projection  n:Sg^_^ 


dA  -  Z.  Further, 


suppose  that  for  every  p  e  dA  -  Z  the  function  g  is  constant  on 


^(p)  =  {u  e  SW  I  (7ro4')(u)  =  p>  =  {u  e  SW  |  'I'(u)  e  n  ^(p)} 
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From  Section  2  g(u)  =  fo4'(u)  <4'(u)  ,  (Woiro't)  (u)>  ^  ,  hence,  if  g  is 

constant  on  (7to4')~^(p),  then  for  all  v  e  ir”^(p) 

f(v)  =  constant  <v  ,  N  >  , 

p 

N  the  normal  vector  at  p  e  -  Z  .  This  expression  for  f  is  the 
p 

usual  Lambertian  condition  for  the  function  f  .  In  optics  it  is  often 
referred  to  as  Lambert’s  cosine  law  ( Meyer-Arendt  1984). 


26.  DEFINITION,  The  function 


R  is  Lambertian  if 

+ 


there  exists  a  function  f^:dA-Z  — >  such  that  for  every  v  e 

fiv)  =  f^iniv))  <v  ,  N(itiv))>.  The  4-form  fv  ,  v  a  volume  element  for 

3 

^dA-'^  ’  said  to  be  a  Lambertian  form. 


The  following  propositions  are  immediate. 


27.  PROPOSITION.  The  4-form  gig* o'  arises  from  a  Lambertian  form 
fv  on  if  and  only  if  g  is  constEint  on  4'  ^  [n  ^(p)]  for  every 

p  e  dA-Z  . 


28.  PROPOSITION.  If  gig  O'  arises  from  a  Lajnbertian  form  fv  on 
S^^-zIR^  ’  ^ ^  inclusion  map,  and  if  is  the 

3 

vertical  projection  of  T^SR  to  its  vertical  subspace  (the  subspace 
tangent  to  the  fiber  at  v),  then  [dgoF^]  =  0  for  every  v  e 
S{U)  .  Here  we  view  SW)  as  an  open  subset  of  SR^  so 
that  dgoV^  is  a  section  in  T*(SR^)  over  8(U)  . 
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Ha 

Recall  from  Theorem  24  that  even  if  gi^  <r  Eirises  from  a  Lambertian 

form  then  it  is  still  the  case  that  for  any  ball  B  such  that  U  c 

there  exists  a  form  f  v  on  S„_IR  with  o')  =  (f  y  ), 

B  B  oB  U  b  UB  B  B  B 

^ - >  SB  .  However,  for  p  =  ir )]  ,  g  may  not  be  constant 

From  Theorem  24  and  the  above  discussion  it  follows  that  on 
&  =  8(U)  it  is  sufficient  to  consider  the  function  g  .  Let  6^  be  the 

3  3 

inclusion  ^ - >  SR  .  We  know  from  Theorem  24  that  for  a 

function  g  with  the  properties  above  a  codimension  one  submanifold 
0^  f|  §  of  g  exists,  but  not  uniquely,  such  that  ij*  [gi^*(r^  = 

j'y*  ["t*  (fy )] .  The  remainder  of  this  section  is  devoted  to  choosing  a 
codimension  one  submanifold  in  8. 

3 

We  shall  say  that  g  is  degenerate  on  a  neighborhood  B  c  SR  if  g 
is  constant  on  U.  If  g  is  degenerate  on  U,  then  it  is  clear  that  g  is 

degenerate  on  §  =  8{U) .  For  example,  as  in  Theorem  24,  a  degenerate  g 

can  anise  from  f  defined  on  S„nR  ,  B  a  ball,  B  z>  niU) ,  by 

B  OD 

f  (v)  =  constant  <v  ,  (Wo7i)(v)>  ,  v  6  S„r,R^  , 

B  OB 

Buid  B  a  unit  normal  field  for  dB.  In  addition,  as  in  the  corollaries 

to  Theorem  24  (Corollaries  25),  the  sajue  degenerate  g  can  arise  from 

any  choice  for  a  set  of  objects  with  f  having  the  same  definition  as 

f  .  Moreover,  for  all  of  these  choices  f  is  Lambertian.  Hence,  if  g 

B 

is  degenerate  on  U,  then  the  condition  that  f  be  Lambertian  is 
satisfied  trivially.  Consequently,  we  shall  exclude  the  case  of  g 
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degenerate  on  U  In  the  remainder  of  this  section. 

Although  we  do  not  develop  it  here,  we  think  the  degenerate  case 

is  extremely  Important.  This  case  is  useful  for  "filling  in"  choices 

of  submanifolds:  if  g  is  degenerate  on  U  but  is  specifed  on  the 

boundary  of  U,  then  a  choice  for  9  (that  is,  for  S„  .R^)  on  U  can  be 

oA 

based  on  variational  methods  such  as  minimal  surfaces. 

If  g  is  nondegenerate  we  shall  use  the  following  tools  to  choose  a 
codimension  one  submanifold  in  8. 

Let  u  be  the  fundamental  form  of  TR^.  That  is,  for  s  the 

1 

standard  coordinate  functions  for  R^,  x  =  s  on,  y  =dx  ,  i=l,2,3, 

.  1  1  ’  i’  >  *  > 

»  .  j;  y,  dx,  . 

1 

Let 

n  =  du  =  ^  dy^  A  dx^  . 

1 

Recall  (Sternberg  1983,  Ch.  3  sec, 7)  that  is  a  nondegenerate  2-form 

and  consequently  provides  a  one-to-one  correspondence  Uy  < - >  X  ,  e 

i'CTr'’),  X  e  KTR^I,  defined  by 

“x  '  • 

We  define  the  horizontal  and  vertical  projections  by 
ff:T(TR^)  - >  T(TR^)  K:T(TR^)  - >  T(TR^) 


Note  that  ff[T(TR^)]  and  7[T(TR^)]  are  orthogonal  complements  of  T(TR^). 
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As  in  the  last  section  we  use  the  inclusion  map  to  pull  back 

objects  from  T(TIR^)  to  T(SR^).  Since  the  inclusion  map  t:SR^  - >  TR^ 

is  a  one-to-one  immersion,  the  differential  dt  and  the  projections  H 

and  V  determine  projections  7^:T(SR^)  - >  T(SR^)  such  that 

dtoH  =  Hodi  and  di^V  =  Vodi  . 

1  1 

3  3 

By  an  abuse  of  notation  we  do  not  distinguish  between  TR  and  SR  with 
regard  to  the  coordinates  =  s^on  . 

We  shall  use  the  following  notation  for  vector  fields.  If  X  is  a 
vector  field,  if  f  is  a  function,  and  if  ^  is  a  diffeomorphism,  then  X^ 
is  a  vector  at  the  point  u  while  X(f)  is  the  function  defined  by  X 
acting  of  f.  In  particular  {d<j>oX]^  =  [d^X}^  = 
use  d<poX  interchangeably  with  d<j)X  . 

29.  LEMMA.  The  map  T(SR^)  - >  T*(SR^)  defined  by  Y  i - >  yjt*n 

provides  an  isomorphism  y^T(SR^)  < - >  -jx  e  H^T*(SR^)  |  X(£^)  =  oj-  .  In 

3 

particular,  for  g  defined  on  &  =  §iU)  c  SR  as  above  there  exists  a 

unique  vector  field  X  ,  „  on  &  such  that 

^  dgoH 

=  ’‘dg.nj  • 


and 
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Proof.  Recall  di  E  =  Eoi  zuid  E 

1 


-  I 


idx 


If  y  e  7  T  (SR  ), 

1  u 


then  0  =  <dt  y  ,  f>.  =  V  dy  (dty  )  y  (lu)  .  But  Y  )  Y  = 

tu  Lt  i  u  i  u  I  u  l 

1  i 

dy^(dty^)  dx^(£(<u))  =  [diy^  J  n](dt  E^).  Since  £1  is  nondegenerate, 


the  image  of  7^T^(SR^)  under  Y  i - >  dfyjfl  is  a  2-dimensional  subspace 

#3  r 

of  OTj^dR  )  which  is  contained  in  the  2-dimensional  subspace  -{X  e 


-o}  . 


Hence  these  two  subspaces  coincide.  Since 


di  is  an  isomorphism  of  HT  (SR^)  to  HT.  (TR^),  t*H  is  injective,  and 

1  u  tu 


the  result  follows  by  considering  t*  (|dty  J  n] . 

The  second  part  follows  from  dgoH^(E^)  =  dg(E^)  =  ^ 


t.oSK<“)3  = 


0  .  In  particular,  <ll[X  „]  =  £  ||-(u)j^ 

®  1  fu  i  I 

1 


tu 


If  dgoH^  does  not  vanish  on  a  neighborhood,  then  the  vertical 
vector  field  does  not  vanish  on  a  neighborhood.  With  this 

vertical  field  we  can  test  dgo7  . 


30.  LEMMA.  =  dxjj^oH^^  ,  that  is  dt/f^oH^  is  horizontal;  in 


particular 


"Mil-  }  =  ^ 

1  u  1 


*,(U) 


Proof;  For  t:SR^  - >  TR^  the  inclusion,  apply  dt  to  the  left 


hand  side  of  the  statement, 
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dtoH^odx/i^oH^  =  HodUdili^oH^  =  Hod(j>^odioH^  =  Hod4>^°Hodi  , 
and  to  the  right  hand  side, 

diodili  oH  =  d(j>  oHodi  . 

From  Section  2  the  matrix  for  d<f>^  in  standard  coordinates  is 


I  tl 

0  I 


Thus,  ]  =  jI- 

1  U  1 


where 


0ju) 


(■^L)  ■ 


is  a  basis  for 


(TR^)].  Hence,  d(f>^oHodi  =  flod^^offodt  ,  which  suffices  to  prove  the 
result.  ■ 

31.  LEMMA.  =  dgoH^  .  In  particular,  if  dgoH^  *  0 

on  an  open  set  U,  then  dgoH^  *  0  on  &{U). 


Proof.  For  u  e  & 


where  (*)  is  by  the  preceding  Lemma. 


32.  LEMMA.  Q  =  <I>^Q  . 


Proof.  For  u  e  & 


1 


i 
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From  the  matrix  for  dtp  In  the  standard  coordinates, 

=  [dyj^  . 

hence  the  result.  ■ 

33.  LEMMA.  =  ^(0*(dgoH  ))oH^  •  generally, 

if  a  is  a  horizontal  1-form  such  that  a(£  )  =  0,  then  V  odip  oX  = 

1  1  a 

Proof.  For  brevity  let  X  =  X,  „  .  Thus,  for  u  e  & 

dgoH^ 

•  • 

••  J 

(apply  =  4>^i  ,  0*n  =  n) 

3i.  PROPOSITION. 
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B1 


Proof.  Note  that  in  Lemma  31  t  is  arbitraur'y.  Hence, 

~  [^(0  )  oH^]u  ~  [^dgoff^ju  ’ 

where  the  first  equality  is  by  Lemma  33  ajid  the  last  equality  is  by 
Lemma  31.  Replace  u  by  ^^(u).  ■ 

35.  LEMMA.  dgoH^odilt^oV^  =  tm"^  ]  .  where  ra"^  is  the 

isomorphism  from  T  g  to  T*6  defined  by  fm  ^(Y  )1(X  )  =  <Y  ,X  >  for 

^  u  u  ^  ^  u  ■>  u  u  u 

vectors  X  and  Y  . 

u  u 


Proof.  Use  the  injection  di.  dloH^od^^oY^  =  Hod0^o7odf  .  But 


)  =  '  3F 


1  'U 


<f>^(u) 


,  consequently,  for  any  X^  e  T^CSIR  ), 


[dtoH^odi/»^oyJ  (x^)  =  [Hodi^^oy]  (dtX^) 


dx 


<P^[u) 


Thus,  =  '[cly^WKu'aF 


=  t  j;dy,(dK^)  d0^(g|-  )  , 


I  '  u 


where  the  last  equation  is  by  Lemma  30.  Since 

]u  ’  foliows  that 


i  u 


1  'U 


dg[[fl^.d*^.l'J(X^)]  =  t  <  > 
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36.  PROPOSITION. 


CV«  3^-)]  = 

^  Is* 


t  <  X 


dgoH, 


dgoH 


>(0  (u)) 

S 


=  t  <  X 


dgoH, 


dgoH^ 


Xu) 


Proof.  The  first  equation  is  by  Lemma  35.  For  the  second 

equation  use  Lemmas  29  and  30:  <  X,  „  ,  X,  „  >(»*  (u))  = 

dgoH  dgoH  s 


Combining  all  of  the  above  Lemmas  we  obtain  our  goal  which  is 
contained  in  the  next  two  theorems. 


37.  THEOREM. 


dgoH'  “dgoff 


Xu) 


Proof.  [dg 


(apply  Proposition  34) 

dg,  ,  ,  {V  odij/  oX^  „  ■] 

(u)  t  1  dgoH  •'u 


(add  and  subtract) 
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(.go^^  =  g  and  Propost  ion  36) 


=  {dg  -  t  <  ,  Xu) 


'dgoH^' 


38.  THEOREM.  On  g  f|  ^g°H^  *  oj-  the  function  {dg 


R 


has  zero  as  a  regular  value,  hence 


is  a  submanifold  of  codimension  one. 


Proof,  Let  0  (u)  6  g  . 


“  arlt-oiC''* 


(apply  Theorem  37) 


d 

dt 


t.c(C‘'« 


=  ■  <  17  >  77  >(u) 

dgoH^  dgoH^ 


(by  Proposition  36) 


=  -  ^  Vh/  Vff  =■  0  • 

C'*®  V.H  5  <“> 


In  particular,  this  holds  for  s  = 


<  X  ,  X  >(u) 

dgoH^  dgoH^ 


This  theorem  is  the  primary  result  of  this  chapter.  In  the  next 


section  we  obtain  a  modification  of  this  result. 


We  conclude  this 
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section  with  some  interpretation  of  the  theorem. 

Of  course,  the  idea  behind  the  theorem  is  that  g  is  given  or  known 

on  a  neighborhood  U  in  SR^.  Note  that  if  g  is  given  on  a  codimension 

one  submanifold  R  that  satisfies  the  conditions  of  Corollary  9,  then 

there  is  a  unique  way  to  extend  g  to  a  neighborhood.  In  either  case, 

dg  and  X.  „  eu'e  then  known  on  the  neighborhood.  Since  g  has  a  unique 
agoH^ 

extension  to  &  =  &W) ,  then  dg  and  X.  „  are  known  on  S.  The  theorem 

agofl^ 

tells  us  that  the  set  in  &  for  which  the  function  dg  X,  „  is  zero  is 

ugon^ 

a  smooth  submanifold.  To  obtain  dg  auid  X.  „  it  is  necessary  that  g 

agon 

be  known  on  a  neighborhood. 

Since  X,  „  is  a  vertical  vector  field,  the  theorem  tells  us  that 
dgoH^ 

3 

the  set  of  points  in  ©  c  SR  on  which  dg  annihilates  this  vertical 
field  is  a  smooth  submanifold.  If  g  arises  from  a  Lambertian  form  on  a 


set  of  objects,  then,  as  was  discussed  in  the  beginning  of  this 
section,  dg  is  horizontal  on  c  SR^,  that  is  dgoV^  =  0.  Recall 
from  the  definitions  of  (i  and)  that  'f(U)  is  the  subset  of 


which  determines  g  on  U.  Consequently,  if  g  arises  from  a  Lambertian 
form,  then  ’iiV)  c  §  j^dg  ~  It  is  an  obvious  corollary  to 


the  theorems  that  for  fixed  u  the  path 


)  I  t  €  R>-  intersects 


l^dg  =  oj’  a-t  only  one  point.  Hence  9(U)  =  S  f)  |^dg  ^^g^g  =  oj-  • 

A  second  issue  Is  the  relationship  between  |dg 

^dgoH  ~ 


and  the 


standard  depth  vision  problems.  As  was  briefly  discussed  in  Section  1, 
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since  g  is  estimated  from  integrations,  it  is  physically  impossible  to 
determine  g  (similtameously)  on  a  neighborhood,  (Even  an  approximation 
requires  a  sequence  of  measurements.)  For  a  fixed  set  of  conditions, 
the  set  of  possible  solutions  for  g  given  on,  say,  a  nowhere  dense  set 
is  certainly  larger  thaji  the  set  of  solutions  for  g  given  on  a 
neighborhood.  However,  the  solution  is  the  only  one 

that  is  consistent  throughout  a  neighborhood  U  with  the  assumption  that 
dgoV^  =  0  on  the  solution  set. 

A  third  point  is  one  regarding  continuity.  The  only  restriction 
on  g  was  sufficient  different iabilty  and  dgoH^  *  0.  This  certainly 
suggests  that  the  results  here  reformulated  appropriately  into  a 
problem  in  terms  of  function  spaces  and  manifolds  would  constitute  a 
problem  that  was  well  posed. 

3 

The  final  point  is  how  the  submanifold  is  positioned  in  g  c  SIR  . 

3 

Certainly,  if  g  arises  from  a  Lambertian  form  on  •  then,  as  was 


seen,  the  solution  idg  X 


is  a  subset  of 


However,  for 


{■ 


dg  X 


dgc 


g,  with 

only 

dgoH^*0, 

there 

is  no  Buarantee 

that 

=  ol  lies 

alone 

fibers  in 

SR^  . 

(For  applications 

the 

interpretation  is  that  the  "apparent  surface"  changes  position  in  IR  as 
the  position  of  the  observer  changes.  )  This  observation  is  of  some 
consequence.  It  says  that  for  an  arbitrary  g,  dgoH^  *  0,  there  is  not 

3 

necessarily  a  surface  in  IR  that  is  compatible  with  g  throughout  a 
neighborhood  U.  This  certainly  suggests  that  problems  that  are  stated 

3 

so ley  in  terms  of  surfaces  in  R  may  be  ill-posed. 
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These  remarks  are  made  precise  by  the  following  corollzu'y  to 
Theorem  38. 

39.  COROLLARY.  For*  "  the  projection  7r: for  m  e  n(U), 


the  submanifold 

8 

m 

=  8iU)  n  f  U  0  [ti  ^(di)'' 
teR  *• 

(j  intersects 

the 

submanifold 

^dgoH  ~  transversely  in 

8W). 

Hence  8  n 
m  ' ' 

\dg  X.  „  =  0 
\  dgoH^ 

is 

a  2-dimensional  submanifold  of  8 

m 

Proof. 

Note 

that. 

for  every  u  e  8  ,  f£  1 

e  T  8 
u  m 

,  whereas 

by 

the  proof  of 

Theorem  38 

‘  ^dg.S,-  “}  • 

And  -j 

r 

dg  X,  „  = 
®  dgoH 

is  of  codimension 

one. 

■ 

Thus  each  point  m  €  n(U)  has  an  associated  2-manifold  in  &(t/). 
When  we  say  that  °}  does  not  necessarily  lie  along  fibers 

we  mean  that  for  a  choice  of  m  e  n(U)  it  is  not  necessarily  the  case 
that  =  o}  =  ,  where  «  =  0  {ci*  o}  ]  ■ 

However,  §  is  not  R^,  Rather,  8  =  U 

teR 

is  a  double  covering  of  R^-{0}.  (For  x  e  R^-{0},  the  two  points 


and  are  in  (R  -{0})xS  ,)  The  sign  of  (dg  la 

is  "in  front  of  m"  of 
"behind  m. "  (Note  that  these  two  cases  are  analogous  to  the 


Theorem  37  determines  whether  -Idg  „=  Oi 

\  dgoH^  J 


distinction  between  real  and  virtual  images  in  optics. ) 
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1.4-  The  sphere  bundle  over  a  curve 

In  this  section  we  push  a  bit  farther  the  results  of  the  previous 
section.  In  the  last  section  we  found  that  the  Lambertian  condition 
determined  a  codimension  one  submanifold  in  the  sphere  bundle.  In  this 
section  we  find  that  we  can  reduce  the  dimension  of  everything  by  one. 

Let  a:  I  - >  (R^  be  a  curve  with  nonvanishing  tangent  vector  a(s) 

for  all  s  e  I.  Since  all  considerations  will  be  local,  let  I  be 


siiff iciently  small  so  that  a(l)  is  a  submanifold  (a  is  a  one  to  one 

immersion  and  a  homeomorphism  into).  Let  S  denote  the 

1  ) 

3 

restriction  of  SR  to  a(I).  Let  S(a(J))  denote  the  unit  tzmgent  bundle 
of  the  manifold  a(I)  and  consider  S(a(I))  as  a  subset  of  S 

a(  J) 

We  claim  that  for  every  u  e  S^^^jR^-S(a( J) )  there  exists  a 

neighborhood  7  c  S  .  ^.R^-S(a(  J) )  about  u  such  that  U  ip  (7)  is  a 

teR 

submanifold  of  SR^.  To  see  this,  first  note  that  U  ip  (7)  =  ipiVxR) . 

teR 

(Recall  ip^iii)  =  ip(.u,t).)  From  the  proof  of  Theorem  8,  7xR  - >  SR^  is 

nonsingular  if  7  f|  S(a(7))  =  0.  In  particular,  there  exists  a 
neighborhood  7x(-2e,2e)  on  which  ip  is  nonsingular  and  one  to  one. 


Shrink  7  if  necessary  so  that  n:(7)  c  B^(ii(u)),  where  rt:  SR 


R^  is 


the  bundle  projection  and  B^in{u))  is  the  ball  of  radius  e  about  7r(u). 
Then  ip  is  one  to  one  on  7xR,  for  if  0  (u  )  =  i/»  (u  )  ,  with  u  ,  u  €  7. 

1  t  2  1^2  * 

1  2 

then  ^  (u  )  =  u  =  ip  (u  )  ,  hence  |t  -t  |  <  2e  ,  which  contradicts 

0  1  1  t  2  12 

2  1 


the  fact  that  ip  is  one  to  one  on  7x(-2e,2e). 


Thus  ^  is  a  one  to  one 
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3  3 

immersion  on  VxR.  It  is  also  an  open  map  since  ^^:SIR  xIR  — >  SIR  is  an 

open  map.  Thus  U  0  is  a  submzuiifold. 
teIR 

Recall  the  definitions  of  the  open  sets  W  8Uid  U  of  SIR^  defined  in 
the  beginning  of  Section  3.  In  particular  V  is  convex  with  respect  to 
Z  =  V-U  has  measure  zero  in  SIR  ,  and  U  is  convex  with  respect  to 

•  By  the  ssune  type  of  argument  as  in  Corollary  9,  Z  f]  V  has 

3 

measure  zero  in  S  ,^.1R  .  Let  us  shrink  K  by  a  set  of  measure  zero  so 

that  V  c  U  =  V  -  Z  ,  so  that  we  may  assume  as  in  Section  3  that  g, 

which  is  smooth  on  U,  is  thereby  smooth  on  V  .  Let  g  =  U  (.V)  and 

^  teIR  ^ 

define  g  on  as  before. 

With  these  preliminaries  we  proceed  to  refine  Section  3  to  find  a 
submersion  on  determined  by  the  Lajnbertieui  condition. 

40.  PROPOSITION.  Let  7  be  a  vertical  vector  field  on  &(U)  such 
that  y  =  .  Then  the  function  dg  Y  satisfies 

(dg  y).*^  ‘dgr  -  t  <x  .  Y>  . 


Proof.  For  u  e  &{U) 

[dg  y]  C*ju))  =  dg^^(^,y^^,^,  =  (<*«•!', 

(adding  and  subtracting) 
=  [dgodifj^  y^  -  (dg.Bj.d^J^  y_^ 

(apply  Lemma  35) 


=  dg^ 


u 


y  - 

u 


t  <X 


dgoH 


y> 


u 
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Let  u  e  S  ,  ,,IR  -S(a(7) )  and  let  u  6  7,  where  V  is  open  in 
ad) 

S  ,  ,1R^-S(a(l))  and  &  =  U  0  (7)  is  a  submanifold  of  SR^.  Let  X  be 

'  teR 

the  horizontal  lift  to  T(SR^)  of  the  tangent  vector  to  the  curve  a. 


That 


for  every  u  €  tt  ^(a(s)). 


Let 


u 


m^:T*(SR^) 


T(SR^)  be  defined  by  diora^ol*  =  m  (recall  t*  is 


surjective),  and  let  =  wodt  .  Recall  dtin^(w^)  =  mCw)  —  E  —  diE^  . 

Thus,  the  1-form  annihilates  E^  .  Consequently, 

there  exists  a  vertical  vector  field  X-  along  a  such  that 

P 


m 


=  CV'*“3u  ■ 


If  u  e  7t"  (a(s)),  then  X^  e  T^g^  ,  for  by  definition  = 

7J^(SR^).  Consequently,  di//^X^  e  T^  .  We  claim  the  vertical 

projection  is  tangent  to  . 


41.  LEMMA.  V^od,/,^-X^  €  T^ 


Proof.  For  7r(u)  =  a(s),  it  is  easy  to  check  that 


dt(X_) 

p 


U  '  I  (‘^"l  (a(s))  -  [  ^  y^du)  dXj(a(s)  )]y^(tu)j 


_a 

ay 


tu 


Then  dto7  odip  o(X_) 

I  t  p  u 


=  ^  j^dx^(a(s))  -  C  Xjdu)  dXj(a(s))]y^(tu)j^ 


( tu ) 


by  the  matrix  for  d<f>^  .  Clearly  V^odilj_^oV^odip^iX^)^  is  tangent  to 
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at  u  €  7r"^(a(s))  since  VT§  =  VT  (SR^).  We  claim 

1  u  1  1  u 

is  in  the  span  of  (£^)^  and  .  This  will 
suffice  to  prove  the  lemma.  But  fffdd  1 1  =  “t 

that  H  d<l>_^{yod<t>JdiiX^)^  =  di^-t  [X^  -  w(X^)(£^)jj  . 


a 

dx 

1 


tu 


42.  THEOREM.  Let  the  curve  a:  I 


SIR  determine  a  submanifold 

Let  V  c 


a(I)  in  IR  and  a  subbundle  S  ,  -S(a( I) )  in  SR 

allj 

S  .  ^vR^-S(a( I) )  be  sufficiently  small  so  that  8  =  U  ^  (l^)  is  a 

'  t€R  " 

3 

submanifold  of  SR  .  A  vertical  vector  field  X„  along  V  is  defined  by 

p 


m 


»  u  €  V  ,  X  the  horizontal  lift  of 


a  .  The  vertical  vector  field  X^  =  V  dtp  X^  along  8  is  tangent  to  8  . 

p  1  t  p  1  1 

The  function  dg  X„  on  8  satisfies 
^  B  1 


Cd«x^]o«.^  =  dg5f^-t<Xp, 


In  particular,  <X_  ,  X.  „  >  =  dgoH  (X)  ,  so  that  if  dgoH  (X)  ^  0  on  7, 
p  dgoH^  1  1 


then  dg  X„  is  a  submersion  and 

p 


{d*  Xp  =  o} 


is  a  codimension  one 


submanifold  of  8 

1 


Proof.  Only  two  things  are  not  covered  in  Proposition  40  and 
Lemma  41.  One  is  <X,,  .X,  „  >  =  dgoH  (X)  =  dg{X)  .  A  brief  proof  is 

B  dgoH^  o  j  o 

ra^(dgoH^)>  .  The  second  item  is  that  in  order  to  apply  Proposition  40 
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we  need  V  dij/  =  X^  .  But  this  follows  from  V  odi/t  oV  =  V  odip  , 
1  p  ^  1  t  1  1 

which  follows  from  the  matrix  for  d(f>^  by  essentially  a  restatement  of 
the  proof  of  Lemma  30.  ■ 

We  can  conclude  this  section  by  restating  everything  from  the  end 
of  the  previous  section.  All  of  the  the  observations  are  still 
relevant.  The  relationship  between  an  arbitrary  dgoH^  known  along  a 
curve  and  dgoH^  due  to  a  Lambertian  sterance  is  the  same.  Secondly,  as 
before,  even  though  the  sterance  is  stationary,  the  2-dimensional 
manifolds  In  ,  m  being  different  points  along  the  curve,  are  not 

3 

necessarily  over  the  same  subsets  in  IR  .  Finally,  as  before,  the 
solution  submanifolds  need  not  be  "in  front  of"  the  observer. 


2  SOLUTIONS  AS  VECTOR  FIELDS  AND  1-FORMS 

2.1  Motivation 

The  subject  of  this  chapter  can  be  viewed  as  a  third  problem  in 
the  sense  that  the  subject  of  the  previous  chapter  was  the  first  and 
second  problems.  In  this  point  of  view,  the  situation  in  the  previous 
chapter  was,  first,  that  the  sterance  was  specified  on  a  neighborhood 
and  then,  second,  that  it  was  specified  along  a  curve.  In  this  chapter 
the  situation  is,  roughly  speaking,  a  generalization  of  the  sterance 
being  given  along  a  curve  with  the  curve  not  being  given.  We  saw  in 
the  previous  chapter  that  the  sterance  plus  the  tangent  vector  to  the 
curve  uniquely  determined  a  submanifold  solution.  It  is  not 
surprising,  then,  that  in  this  chapter  the  problem  is  the  sense  in 
which  both  this  tangent  vector  and  the  submanifold  solution  can  be 
uniquely  determined  by  the  sterance. 

In  this  first  section  we  reexamine  the  results  of  Chapter  1  to 
provide  the  motivation  for  the  contructions  and  the  questions  of  this 
chapter.  In  this  reexamination  we  first  want  to  clarify  what  we  mean 
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by  knowing  the  sterance  but  not  knowing  the  domain.  Then  we  will  use 
the  solutions  from  Chapter  1  to  determine  the  consequences  of  assuming 
only  this  pEu*tial  knowledge. 

The  subject  of  this  chapter  goes  by  various  names  in  the 
applications  literature:  motion  parallax,  motion  stereo,  depth  from 
motion,  and  optical  flow.  It  would,  of  course,  be  possible  to  motivate 
this  chapter  by  discussing  some  of  the  visual  phenomena  associated  with 
motion  parallax.  However,  for  this  the  reader  is  referred  to  the 
psychological  and  engineering  literature  (Collett  and  Harkness  1982; 
Marr  1982;  Prazdny  1983).  Here  we  shall  restrict  ourselves  to  that  for 
which  we  have  reasonably  good  definitions  and  structure.  Since  we  have 
something  resembling  this  in  the  first  chapter,  we  will  stick  to  that 
structure  in  characterizing  our  third  problem. 

It  still  should  be  kept  in  mind  that  the  purpose  of  this  section 
is  motivational.  In  the  second  section  of  this  chapter  the  effort  for 
precision  is  resumed.  We  begin  the  reexamination  with  a  two  paragraph 
summary  of  what  we  have. 

In  the  previous  chapter  we  first  considered  the  case  in  which  the 
function  g  (as  described  in  the  beginning  of  Section  1.3)  was  known  on 


a  neighborhood  U  of  the  sphere  bundle,  and  then  we  considered  the  case 

3  3 

in  which  g  was  known  on  a  neighborhood  K  in  S  ,  »  where  a:  I  — >  R 

a[  i  j 

is  a  curve.  In  both  cases  there  was  a  natural  choice  for  vertical 


vector  fields  and  on  the  manifolds  g  =  &((/)  (dimension  =  5)  and 

&  =  &(.V)  =  \J  tp  (7)  (dimension  =  4),  respectively,  so  that,  for 
*  t€R 


74 


2.1  Motivation 


dg 


*  0.  |dg  =  oj  c  g  and  X^  =  oj-  c  are  codimension  one 


submanifolds. 

We  also  took  note  of  the  manifold  g  =  g(ir"^(oi))  (dimension  =  3), 

02 

which  is  an  embedding  of  S^xR  in  SR^  with  S^x{0>  i - >  n  ^(m).  We 

found,  for  example,  that  for  each  m  =  a(s)  e  n(V),  s  e  I,  g^  intersects 
•j^dg  Xp  =  o|’  transversely  so  that  g^  pj  -^dg  X^  =  o|-  is  a  2-manifold  (see 


Corollary  39).  The  projection  map  n  embeds  g^  Q  -^dg  X^  =  oj- 


as  a 


submanifold. 


It  was  noted  that  in  general  the  2-manifolds 


"[^a(s)  ~  different  for  different  s  e  I 


This  chapter  is  motivated  in  part  by  the  question  of  the 


relationship  between  the  family  of  manifolds  n  K(.)  n  =  o}) 


S€l 


and  the  family  of  functions  1  ^lga(s) 

In  both  of  the  cases  in  Chapter  1,  either  the  case  of  a 
neighborhood  or  the  case  of  a  curve,  the  domain  of  g  was  g  or  g^  .  We 
did  not  consider  the  possibility  that  g  could  have  a  time  dependence. 
That  is,  we  did  not  consider  g:&xl  — >  R  ,  where  I  c  R  is  a  so  called 
time  interval.  Let  us  refer  to  the  case  of  Chapter  1,  g:  g  — >  R  ,  as 
the  stationary  case  for  g  .  Thus,  as  was  noted  at  several  points  in 
Chapter  1,  it  is  physically  possible  to  approximate  a  stationany  g  on  a 

3 

neighborhood  in  SR  using  sequentially  measured  samples,  whereas  it  is 
not  physically  possible  to  obtain  the  measured  samples  simultaneously. 
Let  us  review  some  observations  regarding  the  stationary  case 


solutions  of  Chapter  1. 
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Observation  1.  For  the  first  observation  consider  the  case  of  g 


knovm  on  a  neighborhood  in  SR^  as  in  Section  1.3.  Let  F^:TR^  — >  TR^ 


be  defined  by  ^2’ ^3’ ^2* ^3^ 


(kx^.kXg.kXg.y^.y^.y^),  k  >  0,. 


in  the  standard  (or  natural)  coordinates. 


Let  F,  : SR" 
k 


SIR  b0 


defined  in  the  obvious  way  by  restriction.  Let  g'  =  * 

straightforward  that  F^j^jdg  =  ojj  =  =  oj-  . 


It  is 
This 


example  illustrates  the  role  of  the  domain  of  g.  In  other  words,  if  g 

were  known  up  to  homotheties  of  the  domain,  then  one  would  have  a 

family  of  submanifolds  related  by  homotheties. 

Observation  2.  The  preceding  observation  is  more  interesting  in 

the  case  of  the  curve  a  (Section  1.4).  Again  g  is  stationary.  Note 

that  S  /  ,iR^  =  Us,  .R^.  Similarly,  with  k(x  ,x  ,x  )  = 

aU)  a(s)  1  2  3 


(kx  ,kx^,kx^;  , 


Since  we  can  measure  g 


sequentially,  we  can  consider 
,3 


^'s  ,  .R^  '^3(5)”^ 
a(s) 


R 


the  sequence  of  functions 
We  then  have  the  sequence  of  functions 


is^  ,  ,R=  =  C«-V‘3  Is^  ,  ,r"  ’  ^ 

ka(s)  ka(s) 

33  2 

for  a  fixed  s  and  for  and  identified  with  S  by  the 

natural  coordinates  and  parallel  translation,  that  g|_  ^3  and 

'  b  ,  .IK 
a(s) 

fgoF  1_  „3  are  the  same  functions  on  S^.  That  is,  the  sequence 

^  ^ka(s)‘^ 

of  functions  parameterized  on  s  is  the  same.  It  is  only  the  additional 
knowledge  of  the  two  curves  a  and  ka  that  distinguishes  the  cases. 

There  are  even  more  interesting  examples  if  we  drop  the 
requirement  that  g  be  stationary.  For  example,  for  s  €  I  let  F  be 
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defined  as  but  with  exp(sk)  replacing  k  .  Then  g'  |g 


exp(sk)a(s) 


3  = 


same  sequence  of  functions  on  as 

exp(sk)a(s)” 

^exp(sk)a(s)“^''  identified  with  by 

parallel  translation  and  the  natviral  coordinates.  Here  g'(u,s)  = 
go(F^)  ^(u)  defines  a  nonstationary  function. 


Observation  3. 


A  final  observation  is  the  recollection  of  the 


fact  from  the  previous  chapter  that  even  if  g  is  stationary  and 

3 

a:  I  — >  IR  is  known,  it  is  still  possible  to  have  a  nonconstamt 
sequence  of  2-manlfolds  fl  ~  interest 

here  is  not  that  the  manifolds  "move, "  but  rather  that  there  is  no 
canonical  wav  to  define  a  point wise  correspondence  of  flow  associated 
with  this  sequence  of  manifolds.  Although  the  sequence  of  manifolds  is 


well  defined  by  -Idg  X 


{dg  Xp  =  o}  , 


there  is  not  sufficient  structure  to 


uniquely  define  a  flow.  (See  the  discussion  of  correspondence  by 
Blicher  (1984).) 


Issues  related  to  these  three  observations  above  will  occupy  us  in 
this  chapter.  In  general,  we  wish  to  consider  S  R  for  some  fixed 

Ul 

0 

m  €  R^  and  define  §  =  U  (S  R^)  .  The  parameter  s  that  was 

tsR  0 

previously  the  parameter  for  the  curve  a  is  now  considered  to  be  a 

parameter  for  g  .  That  is.  we  wish  to  study  functions  — >  R  , 

J  c  R,  which  satisfy  g[^^(u)  ,  s)  =  g[u  ,  s}  for  (u,s)  e  &^xl  .  The 

coordinate  s  is  to  be  Interpreted  as  time.  As  usual,  we  assume  g  is 

smooth  where  needed.  Such  a  function  g  on  S  xl  would  arise,  for 

0 


2.1  Motivation 


77 


example,  from  g'  described  at  the  end  of  Observation  2. 

In  this  formulation  we  have  dropped  all  information  about  the  path 
a  and  the  neighborhood  U.  In  the  results  of  Chapter  1  precise 
information  about  the  path  was  required  and  g  was  to  be  stationary. 
This  amounts  to  assuming  that  g:8^xl  — >  R  arises  from  a  rigid  motion 

3 

of  R  .  Here  we  wish  to  remove  this  restriction  emd  to  consider  a  wider 
class  of  motions.  (For  applications  we  have  in  mind  examples  of 

g:&^xl  - >  R  that  arise  not  only  from  observer  motion  but  also  from 

moving  objects  such  as  water  waves,  animals,  wind  blown  grain  fields, 

3 

flapping  flags,  as  well  as  isometries  of  R  .  )  In  fact,  rather  than 
assume  an  isometry,  we  wish  to  determine  to  what  extent  local  analysis 
of  g:&  xl  — »  R  can  be  used  to  "detect"  isometries. 

In  Observation  2  there  is  a  preview  of  the  type  of  degeneracies 
that  will  be  faced.  The  example  involving  is  equivalent  to  the 

observation  that  g:&^xl  - >  R  does  not  vary  if  the  objects  about  an 

observer  at  collapse  (are  retracted  to  m^)  or  expand  along  radial 

lines.  Thus  giS^xI  >  R  cannot  "detect"  such  motion;  i.e.,  g  is 

invariant  under  such  motion.  From  Observation  3  there  is  the  second 
preview  that,  even  if  a  moving  manifold  is  specified,  an  associated 
flow  is  not  necessarily  uniquely  determined. 

A  first  result  from  these  remarks  is  that  we  may  drop  the  pretense 
of  working  in  the  sphere  bundle.  With  the  understanding  that  we  are 
interested  only  in  points,  not  at  the  origin,  we  have  the  following. 
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Remark.  Without  loss  of  generality  we  may  replace  — *  K 

with  gi  (IR^-{0})xI  — >  R  . 

Reason.  We  can  identify  R^-{0}  with  U  (S  R^)  c  U  0  (S  R  )  = 

t<0  0  teR  0 

S  ,  2ind  R^-{0}  suffices,  for  we  may  reflect,  if  necessary,  any  of  the 
0 

codimension  one  submanifolds  of  Chapter  1  (e.g. ,  dA,  X  =  o}]  , 

through  the  origin  because  of  the  0^  invariance  property  of  g  . 


3 

The  problem  of  selecting  (moving)  submanifolds  in  (R-{0>)xI  that 
are  consistent  with  a  given  g:  (R^-^O)  )xJ  — >  R  has  at  least  the 
degeneracy  of  the  problems  in  Chapter  1.  In  Chapter  1  we  had 
nonuniqueness  in  general,  but  unique  Lambertian  submanifolds.  We  seek 
similar  conditions  for  a  well  posed  problem  for  selecting  submanifolds 

consistent  with  g:(R^-(0>)xI  - >  R  .  In  this  chapter  we  shall  make  an 

assault  and  some  progress  on  this  problem.  Our  progress  will  at  times 
consist  of  solving  a  subproblem  which  we  call  the  still  picture 
problem. 


3 

DEFINITION.  We  say  that  a  problem  involving  g:(R-{0})xJ  — >  R 
satisfies  the  still  picture  condition  if  whenever  g  satisfies 

g{m,s)  =  gim,s^)  ,  (fli, s)  e  (R^-{0>)xJ  ,  fixed  in  J, 
then  the  only  possible  flow  on  R^-{0}  is  the  identity. 


[e  m 


Since, 

,  s  +s 
0 


for  example,  the  flow  on  (R^-{0>)xI  given  by  <p^(m,s^)  - 
]  does  not  change  g,  then  there  obviously  must  be 


some 
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additional  structure  for  the  problem  to  satisfy  the  still  picture 
condition.  In  this  study  we  have  adopted  this  still  picture  condition 
as  our  first  question  to  be  asked  (euid  answered)  in  seeking  to 
understauid  mathematical  structures  for  modeling  depth  vision  phenomena. 
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2.2  Space,  basis  vectors,  flows,  and  forms 

In  the  last  section  (R  -{0})xl  was  identified  as  the  space  of 
interest.  In  this  section  definitions  and  some  elementary 

relationships  are  presented.  As  in  Chapter  1,  we  are  pursuing  local 
results,  and  we  will  ignore  2uiy  closed  set  of  measure  zero.  The 
structure  of  the  ignored  sets  is  contained  in  Theorem  10  of  Chapter  1: 
we  are  ignoring,  among  other  things,  "edges. "  Since  everything  in  this 
chapter  is  local  (i.e.,  we  only  need  some  open  set  around  the  point  of 
interest),  it  suffices  to  know  that  the  ignored  set  is  closed  and  of 
measure  zero.  The  additional  structure  given  in  the  theorem  can  be 
neglected. 

Let  (flj,  t)  €  (R  -{0})xJ  ,  where  I  is  an  open  interval  in  R  .  In 
this  chapter  t  will  always  be  an  element  of  I.  The  natural  coordinate 
functions  for  (R^-{0})xI  will  be  denoted  by  x^,x^,x^,s  :  if  m  = 
im  ,  m  ,  m  )  e  R  -{0>  ,  then  x  (m,t)  =  m  ,  i=l,2,3,  and  s(m,  t)  =  t  . 

12  3  I  i 

3  d  3 

(R  -{0>)xJ  is  equipped  with  the  standard  metric  ^ — >  =  5  , 

dx  dx  11 

1  J 

3  3  3  3  3 

—  ,  3— >  =  0  ,  =  1  .  The  vector  field  ^  determined  by  the 

ox^  as  as  as  as 

natural  coordinates  will  often  be  denoted  d  .  Equivalently,  S  = 

s  s 

grad(s) . 

2  2 

For  m  =  (m^,m^,m^),  let  |m|  =  J]  m  .  The  smooth,  positive  valued 

1 

function  p  on  (R^-{0})xJ  is  defined  by  pim,t)  =  |m|  . 
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1.  DEFINITION.  The  position  vector  field  H  on  (R  -{0})xJ  is 

Q 

defined  by  K  =  x  .  The  one  parameter  group  of  diffeomorphisms 

i 

of  the  vector  field  3?  is  denoted  by  ,  r  e  R  . 

3 

It  is  fairly  easy  to  see,  for  (m,t)  e  (R  -{0})xJ,  that  ‘&^(.m,t)  = 

T®/  “D  .  where  ..  is  the  geodesic  determined  by  the  initial 

Ji\m,  t)  K[.m,  t ) 

tangent  vector  KCm, t)  .  In  particular,  is  a  complete  vector  field  on 
(R^-{0>)xI  ;  that  is,  is  indeed  defined  for  all  r  e  R  . 

The  following  elementary  consequences  are  noted:  ds  3?  =  0;  so'&^  = 
s;  dp  ‘R  =  p;  Inp  is  well  defined  on  (R^— {0})xJ  and  dlnp  3J  =  1;  3?  = 
p  gradp  .  Since  p°'&^  =  e  p  and  since  commutes  with  d,  dlnp  = 
dlnp  . 

In  this  chapter  two  types  of  figures  will  be  used.  Each  type  has 
its  unique  ambiguity.  In  Figure  5  the  vectors  R{m,t)  and  8  im,t)  are 

5 

illustrated  for  a  fixed  (m,t)  e  (R^-{0})xJ  .  In  Figure  5a  the  first 
factor  R  -{0}  of  (R  --{0>)xl  is  displayed  ambiguously  as  a  quadrant  of  a 
two  dimensional  plane  whereas  the  second  factor  I  is  displayed 
unambiguously.  In  Figure  5b  the  second  factor  I  is  ambiguously 
displayed.  The  two  dimensional  plane  in  Figure  5b  is  used  to  represent 
either  the  slice  (R  -{0})x{t}  or  the  image  of  the  projection 
7r:  (R^-{0}  )xl  - >  R^-{0}  . 

We  wish  to  consider  vector  fields  on  (R  -{0})xJ  that  correspond  to 
the  so  called  nonautonomous  or  time  dependent  vector  fields  (Arnold 
1973,  Ch.2  sec.  8).  We  also  wish  to  restrict  the  consideration  to 
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those  vector  fields  that  are  consistent  with  the  scaling  observations 
of  the  previous  section. 


Figure  5 


2.  DEFINITION.  An  admissible  vector  field  is  a  vector  field  X  on 

a  neighborhood  U  c  iiR  such  that 

L  U  =  U  ^  (£/)  , 
reIR  ^ 

a.  ds  X  =  1  , 

ILL.  [X, K]  =0  ,  where  [,]  is  the  Lie  bracket. 

The  local  one  parajneter  group  of  X  is  denoted  {(p  }  (Warner  1971, 

<1, 

Definition  1.49).  From  Definition  2  one  has  several  elementary 


consequences . 


First  one  can  apply  the  standard  result  that  linear 
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independent  vector  fields  with  vanishing  Lie  bracket  have  commuting  one 
parameter  groups  on  a  sufficiently  small  neighborhood  (Bishop  and 
Goldberg  1968,  Theorem  3.7.1).  Since  ds  X  =  1  and  ds  31  =  0  ,  X  and 
are  linearly  independent  on  U.  Since  K  is  complete,  there  is  the 
following  (Figure  6). 

3.  LEMMA.  d‘&  X  =  X  on  U.  If  <p  is  defined  on  F  c  (IR^-(0>)xI 
r  A 

for  A  €  J  c  R  ,  then  <p  is  defined  on  U  ^  (F)  and  ®  =  ■^  om  , 

_  r  A  r  r  a 


Proof.  For  any  (m,  t)  6  U  ,  cover  the  compact  set  K  = 

n 

U  by  a  finite  collection  of  neighborhoods  in  which  the 

-n^rsn 

local  one  parameter  groups  commute,  hence  in  which  X  =  X  .  By  the 

completeness  of  R  and  by  the  group  property  of  it  follows  that  this 

holds  on  ,  hence  on  U  .  It  is  then  easy  to  check  that  the  integral 

curve  of  X  at  (m,  t)  is  om  ,  and  the  last  statement  follows 

r  r  <i 

by  uniqueness.  ■ 


Figure  6 
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An  additional  consequence  of  Definition  2  is  the  following.  Since 
ds  X  =  1,  then,  for  (m,  t)  in  the  domain  of  t)]  =  t  +  ■&.  = 

4^  4l 

s(m,  t)  +  A  .  Thus,  since  <p  commutes  with  d,  (p  ds  =  ds  . 

We  digress  briefly  for  a  few  remarks  on  motivation  and  modeling 
regarding  the  choice  of  definition  for  the  admissible  vector  field. 
First,  the  flow  <p^  determined  by  a  time  varying  vector  field  X  is  the 
obvious  generalization  of  the  transformations  discussed  in  the 
Observations  of  Section  1.  Second,  it  is  readily  seen  that  for  fixed  r 
the  action  of  the  map  is  an  expansion  or  contraction  of  the  vector 

3  2" 

space  R  by  the  factor  e  .  Thus,  the  invariEuice  of  the  flow  is 

the  generalization  of  the  invariance  under  scale  change  discussed  in 
the  Observations. 

However,  one  might  consider  choosing  a  flow  {a  }  that  models  a 

motion  from  mechanics  rather  than  one  that  commutes  with  .  An 

r 

3 

example  is  the  choice  that  is  an  isometry  of  R  .  There  are  many 
reasons  why  such  a  restriction  is  not  used,  some  of  which  will  become 
apparent  later.  One  of  the  reasons  can  be  made  precise  immediately: 
it  is  that  such  a  choice  for  (p^  can  not  in  general  be  made  in  a  manner 
that  is  consistent  with  the  sterance  function  g  .  The  following 
definition  for  sterance  function  is  the  obvious  adaptation  of  the 
function  g  from  Chapter  1. 

4.  DEFINITION.  A  sterance  is  a  function  g:(R^-{0})x/  - >  R  that 

is  smooth  except  on  a  closed  subset  of  measure  zero  and  that  satisfies 

ng)  =  0  . 
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It  is  8in  immediate  consequence  that  go‘&^  =  8  ,  r  e  IR  ,  hence 
dg  =  dg  .  (The  invariance  of  g  is  the  exact  analog  of  the 
invariance  in  Chapter  1.) 

It  follows  from  the  definition  that  g  is  determined  by  > 

the  restriction  of  g  to  S^xJ  .  For  a  fixed  t  e  I  we  call 
image  associated  with  g  at  t  ;  we  call  the  image  sequence.  In 

view  of  the  fact  that  g°‘&^  =  g  ,  a  distinguised  role  for  ^1^2^^  is  of 
significance  only  for  applications:  the  image  sequence  ^1^2^^  is  the 
function  that  is  approximated  in  physical  measurements. 

5.  DEFINITION.  An  admissible  vector  field  X  defined  on  a 
neighborhood  1/  c  (R  -{0})xl  and  a  sterance  g  are  said  to  be  compatible 
if  g  is  smooth  on  U  and  if  X(g)  =  0  on  U  . 

An  immediate  consequence  is  that,  on  a  domain  of  definition  JxV  of 
the  local  one  parameter  group  ofX,  <ie(-e,e)=JcR,  V  c  U  , 

Ik 

we  have  go<p  -  g  ,  hence  (p  dg  -  dg  .  This  invariance  of  g  along  a 

A 

path  <pjim,t)  ,  <i.  e  J  ,  is  analogous  to  the  Lambertian  condition  of 

Chapter  1. 

It  can  now  be  seen  that  the  condition  that  m  and  ■&  commute  is 

A  r 

sufficient  for  the  consistency  of  <p  and  -&  with  sterance.  For,  by  the 

■0.  r 

definition  of  sterance  and  by  the  definition  of  compatibility, 

=  g°<P^  =  8  =  =  g°<P^°'^j^  ■ 
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dg 

If  dg  -  *  0  we  have  three  linearly  independent  functions,  g  , 
Inp  ,  and  s  ,  on  the  4-manifold  (IR^-{0})xJ  .  This  is  typical.  The 
introduction  of  the  sterance  function  always  leaves  us  one  function 
short  of  a  chart  for  any  of  the  manifolds  used  in  vision  problems. 
This  gap  is  frequently  noted  and  is  often  filled  by  changing  g  from  a 
real  valued  function  to  a  map  into  c  a  2.  This  is  done  typically 
to  model  the  physical  phenomena  of  color.  (See  for  example  Blicher 
1985.  )  We  shall  not  do  this.  Instead,  we  will  make  do  with  three 
functions,  but  from  the  three  lineeu'ly  independent  1-forms  we  will 
determine  a  fourth  by  the  Hodge  star  operator.  In  this  way  we  will 
have  defined  a  bundle  of  bases  on  -j^dg  -  ^ds  *  0 

A  convenient  definition  of  the  Hodge  stsu'  operator  (Flanders  1963, 
15-7)  uses  the  metric  induced  on  1-forms  by  metric  equivalence  (O’Neill 
1983,  60).  Let  H  be  an  n-dimensional  Riemannian  manifold,  Let  m  e  M  . 
Metric  equivalence  refers  to  the  existence  of  the  isomorphism  m  from 
1-forms  at  m  to  vectors  at  m  defined  by  <m(w)  ,  X>  =  u(X)  for  all 
1-forms  u  e  T*M  and  all  vectors  X  e  T  M  .  The  inner  product  of  1-forms 

m  in 

w  and  u  is  defined  by  <u  ,  u  >  =  <ra(u  )  ,  m(u  )>  .  For  p-forms  at  m 
the  inner  product  is  defined  by  defining  for  decomposable  elements  v  = 
VA...AV  and  p  =  pa...a|j  ,  <v  ,  p>  =  det(<v  ,u>)  .  For  M 

1  p  1  p  1  j 

orientable,  choose  a  volume  element  tr  .  (We  assume  a  positive  definite 
metric,  hence  <(r,  <r>  =  1.  )  The  Hodge  star  operator  *  acting  on  a  p-form 
V  produces  an  (n-p)-form  »v  defined  by 

VAp  =  <*v  ,  p>  <r  ,  for  all  (n-p) -forms  p  . 
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From  the  smoothness  of  the  metric  tensor  it  follows  that  •  maps 
differential  p-forms  on  M  to  differential  (n-p)-forms  on  M  . 

We  define  a  differential  1-form  on  (IR^-{0})xI  by 
P  =  •  (  dp  A  dg  A  ds  )  . 

We  shall  repeatedly  use  the  following  elementary  facts  about  /S  .  (The 
notation  for  the  norm  associated  with  the  inner  product  of  any  of  the 
vector  spaces  is  II  II  =  <  ,  >  . ) 


6.  PROPOSITION. 

1.  0  =  <P,dp>  =  <|3,dg>  =  <^,ds>  . 

2.  Ilpll  =  Ildg  -  l^sll  . 

OS 

3.  ^  0  . 


Proof.  Statement  1  is  Immediate.  For  example,  </3,dp>(r  = 

de 

dpAdgAdsAdp  =  0  .  For  statement  2,  if  dg  -  -^ds  =  0  then  we  are  done. 
Otherwise,  by  1  we  have  that  dp  ,  - ^ -  ,  ds  ,  TrWrr  are 


ortho  normal ,  hence  <r  =  dp  a 


dg  -  ?Sds 

*  ""  .ds.  K  -  "• 


lid*  -  |fds« 


II  dg  -  ||dsll  II  pH 


To  prove  statement  3,  we  express  p  in  spherical  coordinates.  For  = 
p  sin0  cos(p  ,  x^  =  p  sine  sin^  ,  x^  =  p  cos0  ,  sin0  *  0  ,  with 


dx^Adx^Adx^Ads  =  cr  ,  then  dpf^dQf\d<pAds  =  — 


Since  dg  = 


p  sin0 


||d0  +  ||d0  +  ||ds  ,  <dp,dp>  =  1  ,  <d0,d0>  =  1/p^  ,  <d<p,d<j»  = 

l/(p^sin^0)  ,  <ds,ds>  =  1  , 


it  follows  that 
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0  =  -T-fl  S  -  sine  If  d<t>  . 
sine  d<p  ae  ^ 


The  desired  result  follows  from  eo'd  =  e  ,  doia  =  6  , 

r  r  ^  a^  r 

=  M  .  , 

ae  r  ae 


ag  ^ 
^ 


It  is  convenient  to  have  an  indexed  notation  for  these  four 

•  ._3  .  ,  .  •  _  ^ 


(m,  t) 


1-forms  that  zu'e  a  basis  for  T,  ..(R  -{0})xJ  when  dg  -  -^^s 

{m, t)  as 

0  .  We  use 

2»  -  3»  ,,  4* 

e  =  dg  ,  e  =0,  e  =  dlnp  ,  e  =  ds  . 

We  denote  the  four  vector  fields  that  are  dual  to  {e^*}  by  {eH  .  We 


also  use  e 


e  ,  e  =  e-  ,  e  =  e 
g  2  0  ’  3  p 


e  =  e 

4  S 


It  is  easy  to  see 


gradg  -  Ifs  „ 

that  e  =  - :r- — ^  ,  e  =  3?  ,  and  e  -  d  -  by  checking 

p  s  s  ds  g  ^  ^ 


g 


Igradg  -  Ifa  11^ 

OS  s 


that  e  (e  )  =  5  . 

J  iJ 


7.  PROPOSITION. 

1.  lie  II  = 
g 


II 011 


=  "-0" 


2 .  d'Q  e  =  e  ,  hence  [  31,  e  ] 
r  1  1  ’  1 


=  0  ,  i=l,2,3,4 


Proof.  The  first  equation  in  statement  1  follows  fron  the 


formulas  for  e^  and  statement  2  in  Proposition  6.  For  the  second 

equation,  note  that  statement  1  of  Proposition  6  implies  tn(0)  = 

constant *6  . 

0 

Statement  2  follows  from  the  fact  that  O*  e^*  =  e'*  ,  i=l,2,3,4  . 
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Note  that  three  of  the  1-forms  are  differentials  of  functions. 
However  d|3  need  not  vanish.  From  this  observation  we  have 


8,  PROPOSITION.  * 


i.j  =  1,2, 3, 4  . 


The  following  table  summarizes  the  definitions,  notation,  and 
results  of  this  section. 


TABLE  1 


functions 

g 

P 

pirn,  t)=|m| 

S 

vector  fields 

flows 

X 

<p  (local) 

A 

i  i 

r 

8  =grads 

S 

1 -forms 

T 

dua  1 

e  =dg 

e^*=(3 

e  =dlnp 

e'^*=ds 

'i' 

vector  fields 

e  =e 

e  =e„ 

e  =?? 

e  =8 

1  g 

2  p 

3 

4  s  5s  g 

gradg-^, 

llgradg-%  II 

os  s 


relations  ®  =■&  om  go'&  =g 

r  r  ®  r 

g°<P=g 

A 


r 

d'd  e  =e 
r  i  i 

[K, ]=0 


[X,J?]=0 


30  2.2  Space,  basis  vectors,  flows,  and  forms 

lie  11^  0  0  -l^lle  11^ 

g  8s  g 

0  lle^ll^  0  0 

0  0  0 

-  ^Ile  11^  0  0  l+f^]^lle  11^ 

ds  g  ^si  g 

It  is  easy  to  see  from  Table  1  that  for  any  steremce  g  there 
exists  admissible  vector  fields  that  are  compatible  with  g  ,  The 
simplest  example  is  the  vector  field  e^  .  Another  is  .  More 

precisely,  X  =  p(X)  e  +  dlnp(X)  R  +  e  is  admissible  if  aind  only  if 

p  ^ 

R[|3(X)]  =  0  and  R[dlnp(X)]  =  0  ,  for  then  [X.R]  =  0  .  If  this  X  is 

admissible,  then  it  is  clearly  compatible  with  g  .  This  is  summarized 

in  the  following. 

9.  PROPOSITION.  Let  g  be  a  sterance  that  is  smooth  on  1/  c 
([R^-{0})xJ  and  assume  dg  -  ^ds  *  0  on  U  .  Then  there  exists  vector 
fields  on  U  that  are  compatible  with  g  . 

To  say  that  X  is  compatible  with  g  is  to  say  that  the  motion 
(p^{m,t)  ,  e  J  ,  of  a  point  im,  t)  is  contained  in  a  level  set  of  g 

(Figure  7).  Equivalently,  g  is  constant  along  <p  This  latter  is 

the  usual  point  of  view  for  applications;  the  sterance  associated  with 
the  point  (m,  t)  does  not  change  as  the  point  moves.  In  this  latter 
sense  g  is  a  consequence  of  a  motion.  This  is  analagous  to  our 
consideration  in  Chapter  1  of  a  form  gig  <r  that  is  a  consequence  of  a 
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Lambertian  form  fv  (Propositions  27  and  28).  Just  as  in  Chapter  1,  to 
get  a  well  posed  problem  we  do  not  place  such  restrictions  on  g  .  As 
in  Chapter  1,  g  has  essentially  no  restrictions.  Instead,  we  will 
study  subsets  of  admissible  vector  fields. 


Figure  7 


In  this  section  there  has  been  no  mention  of  objects  or  surfaces. 
In  fact,  there  will  be  no  mention  of  these  until  Section  4.  The  reason 
for  this  was  suggested  in  the  first  section  but  can  now  be  made 
precise.  Let  S  be  a  neighborhood  in  any  surface  such  that  K  is  nowhere 
tangent  to  S.  Then  is  a  family  of  surfaces  and  for  each 
surface  its  motion  due  to  admissible,  compatible  X  is  pointwise  along 
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level  sets  of  g. 

In  applications  this  situation  is  frequently  stated  in  the 

following  majiner:  the  absolute  distance  from  the  origin  to  a  moving 

surface  cannot  be  determined  from  g\^^j  .  where  the  sterzuice  g  is  the 

consequence  of  a  Lambertian  form  on  the  surface. 

In  light  of  this  it  is  not  meaningful  to  introduce  a  surface. 

However,  (S)>  suggests  that  we  introduce  {d'&  (TS)}  ,  that  is,  an 

r  r  r  r 

involutive  distribution,  and  that  we  seek  relationships  between  X  ,  g  , 
and  integral  manifolds  of  this  distribution. 


2.3  Parallel  fields,  geodesic  variations  in  images 
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2.3  Parallel  fields,  geodesic  variations  in  images 

In  The  last  section  we  saw  that  admissible,  compatible  vector 

fields  always  exist  but  are  not  uniquely  determined  by  the  sterance. 

In  this  section  we  will  consider  a  subset  of  admissible  vector  fields. 

In  this  restricted  subset  we  obtain  a  uniqueness  result,  up  to  images 

2 

which  satisfy  a  condition  related  to  geodesic  variations  on  S  .  When 

this  uniqueness  result  is  applied  to  the  case  of  a  constant  image 
de 

sequence,  i.e.,  ^  find  that  this  restricted  problem  satisfies 

the  still  picture  condition. 

The  following  terminology  is  standard  (for  example,  O’Neill  1983, 
Ch.3).  For  vector  fields  V  and  W  on  (lR^-{0>)xJ  ,  let  DyW  denote  the 

natural  covariant  derivative  of  W  with  respect  to  V  , 

=  Z  V(dxW)  ^  +  V(ds  W)  ^  , 

1  i 

where  x  ,  x  ,  x  ,  s  are  the  natural  coordinate  functions.  A  vector 

1  2  3 

field  P  is  said  to  be  parallel  if  DyP  =  0  for  all  vector  fields  Y  .  A 

related  case  is  ds  P  =  0  and,  for  all  Y  such  that  ds  Y  =  0,  D^P  =  0  . 

That  is,  P  is  tangent  to  and  parallel  in  R  -{0}x{t}  ,  but  P  need  not 

S 

vanish. 

Let  X  be  an  admissible  vector  field.  Let  X  and  sterance  g  be 

compatible  on  a  neighborhood  U  (where  we  may  assume  1/  =  U  ((/)  )  in 

reR  ^ 
ds 

which  dg  -  ^  0  .  In  this  case  we  have  on  U  the  four  linearly 

os 

independent  vector  fields  e  =e  ,  e  =e„  ,  e  =3?  ,  e  =e  ,  and  the  dual 
^  lg’23’3’4S’ 
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1-forms  dg  ,  p  ,  dlnp  ,  ds  .  Therefore  X  =  p(X)  e-  +  dlnp(X)  R  +  e  , 

p  s 

since  dg  X  =  0  and  ds  X  =  1  . 


10.  THEOREM.  Let  X  and  X'  be  admissible  vector  fields  on  U  c 
(IR  — {0})xf  ,  and  let  g  be  a  sterance  such  that  both  X  and  X'  are 
compatible  with  g  on  U.  If  there  exists  a  vector  field  P  *  0  on  U  , 
with  DyP  =  0  for  all  Y  with  ds  7  =  0  ,  and  a  smooth  function  h  on  U 
such  that  X'  -  X  =  hP,  where  the  measiore  of  {h=0}  is  zero,  then 

(1) 


P(P)  e  )  =  0 

P  ^ 


and 


piP)  p{p^  =  dlnp(P)  .  (2) 


Proof.  It  follows  from  the  admissibilty  and  compatibility  of  X 

and  X'  that  hP  =  dlnp(hP)  31  +  p(hP)  e_  .  From  the  matrix  for  <e  ,  e  > 

P  i'  j 

in  Table  1  of  Section  2,  it  follows  that  <hP,e  >  =  <hP,e  >  =  0  on  {/  . 

g  s 

Let  e  =e^  and  e  =e  .  It  follows  by  continuity  and  from  the  fact  that 
1  ^  4  s 

{h=0}  has  measure  zero  that 


<P,e>  =  0  on  U  ,  j=l,4  .  (a) 
Since  y<P,  e^>  =  <DyP,e^>  +  <P,Dye^>  ,  we  have  for  every  vector  field  Y 
with  ds  y  =  0  , 


<P,Dye>  =  0  on  U  ,  j=l,4  . 

Note  that  =  Y  for  any  vector  field  Y  .  Recall 
Hence , 

pdpiDyC^)  =  <3?,Dye^>  =  y<e^,e^>  -  <D.^.e>  =  -<Y,e>  , 


(&) 

=  3?  =  p  gradp  . 

J=l,2,3.4  .  (c) 
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Since  =  dlnpCD^e^)  K  +  piD^e^)  e^  +  (terms  in  ,  e^)  ,  it 

follows  from  (a),  (&),  and  (c)  that 

2 

0  =  <P,Dye>  =  -dlnp(P)  <Y.e>  +  $(P)  ^CVj^ 

Recall  113111^=  and  lleJI^  =  He  11^  .  Note  He  II  *  0  .  (See  Table  1.  ) 

P  S  S 

From  (•)  with  J=1  and  with  ^=6  it  follows  that 

O 

0  =  -dlnp(P)  +  3(P)  p(p  e  ]  : 

g  ^ 

with  y=e-  it  follows  that 
p 

0=0  +  0(P)  p[D  e  )  . 

(Note  that  (•)  is  trivial  for  7=31  .  Also  (•)  with  j=4  leads  to  the 
same  results,  for  e  =  e  =  3  -  and  8  is  parallel.  )  ■ 

4  S  s  OS  g  s 

It  is  easy  to  see  that  if  hP  =  X'  -  X  ,  then  31(h)  =  h  ,  for  [31,  hP] 
must  vanish  if  X  and  X'  are  admissible,  and  [31,  P]  =  P^P  -  Pp31  =  -P  . 
Consequently,  there  exists  admissible  vector  fields  X  +  hP  .  An 
admissible  vector  field  8  +  hP  is  illustrated  in  Figure  8. 


Figure  8 
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The  following  corollaries  explain  why  the  theorem  is  interesting. 
Note  that  U  pj  s~^(t)  =  ^  f)  IR^“<0>x{t>  .  The  coroll2a'ies  are  direct 
consequences  of  statements  (1)  and  (2)  of  the  theorem. 

11.  COROLLARY,  f'oi'  P  as  In  the  theorem,  if  there  exists  a  point 

(m,  t)  e  1/  n  such  that  8iP) ,  =  0  ,  then  P  =  0  on  1/  n  • 

' '  (m,  t )  ' ' 

Proof.  Apply  statement  (2)  of  the  theorem  and  0  =  dg  P  =  ds  P  .m 

Qg 

12.  EXAMPLE.  Let  ^  =  0  on  1/  .  Hence,  on  U  the  image  sequence 

gLa  ,  is  a  still  picture,  g|_2  ,  =  •  Let  X  =  e  ,  hence  X  = 

'S  xl  ®'S  xJ  ®'Sx{t}  s 

a  .  Thus  <p  =  id  X  {ti - .  The  corollary  tells  us  that  X  +  hP  = 

S  ^ 

a  +  hP  ,  P  *  0  ,  cannot  be  compatible  with  a  still  picture  if  any 

S 

point  (m,t)  €  U  has  t)  ^  ®  •  Note  that  it  is  not  necessary  that 

h(m, t)  *  0  . 

The  vector  field  d  +  hP  with  h  *  0  is  frequently  implicit  in  the 

S 

engineering  literature.  Compare  the  problem  of  finding  the  "focus  of 
expansion,"  that  is,  a  point  (m,t)  such  that  p(m,  t)  =  0  ,  in  Prazdny 
(1983). 

The  proofs  of  the  next  two  corollaries  are  immediate. 

13.  COROLLARY.  With  P  as  in  the  theorem,  if  there  exists  a  point 

(m,  t)  e£/p)s^(t)  such  that  dp  P  =  0  and  /SfD  e  ]  0  ,  then  P  =  0  on 

u  n  s'Ut)  . 
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The  following  result  is  of  more  significance  than  the  preceding 
two  for  it  depends  on  only  the  image  • 


14-.  COROLLARY. 
im,t)  €  U  f|  s"^(t) 

U  n  s~^it)  . 


With  P  as  in  the  theorem,  if  there  exists  a  point 


such  that  p\D  e\,  ..  ^0  ,  then  P  =  0  on 

e^  gJ  (m,  t) 


This  result  is  of  the  type  we  are  seeking.  First,  it  is  local: 


pfZ)  e  ]  depends  on  only  the  germ  of  g  at  (m,  t)  .  Second,  it  provides 
a  uniqueness  result.  For  example,  if  ^  =  0  on  £7  and  ^  ^(m  t)  *  ^ 

P 

for  any  (m,t)  €  U  ,  then  there  is  a  neighborhood  U  £/  f|  s~^{t)  on 

I  t|<e 


which  8  +  hP  is  a  solution  if  and  only  if  P  s  0  . 

s 

The  following  corollary  provides  some  insight  into  what  the  image 
look  like  locally  if  P  ^  0  .  Recall  the  definition  of 

geodesic  variation.  Here  we  follow  O’Neill  (1983,  Ch.8).  A  two 

2  2  2 
parameter  map  x  into  S  is  a  map  x:2)  — >  S  ,  where  D  is  open  in  R  and 

2 

where  horizontal  and  vertical  lines  in  R  intersect  2)  in  intervals. 

2 

Let  (u,v)  be  the  natural  coordinates  for  R  .  The  u-parameter  curves 

u  I - >  xiu,v^)  are  called  longitudinal.  A  two  parameter  map  x  is  a 

geodesic  variation  if  every  longitudinal  curve  of  x  is  a  geodesic. 
With  3  ,3  the  natural  coordinate  tangent  vectors  of  2)  ,  there  are 

u  V 

the  two  vector  fields  along  x  ,  dx(3  )  and  dx(3  )  . 

u  V 

T  2 

Recall  that  the  covariant  derivative  D  on  S  x{t}  induced  from  D 

3 

on  (R  -{0})xl  is  defined  by  taking  the  tangential  component,  and  a 
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2  T  • 

curve  y  is  a  geodesic  on  S  x{  t}  if  and  only  if  D-  y  =  0  .  Recall  that 

y 

e  and  e„  are  tangent  to  S^x{ t}  . 

S  P 

15.  COROLLARY.  For  P  as  in  the  theorem,  P  ^  0  if  and  only  if  for 
every  (m,  t)  e  {P^Or^I/  there  exists  a  geodesic  variation 
x:  [-e,  e]x(-5,  5)  - >  ^ - >  (IR^-{0>  )x{  t}  such  that  x(0,0)  =  (m,  t)  and 

”  irar  •  ■ 

P 

Consequently,  P  0  if  and  only  if 


that  is,  e^  is  a  Jacobi  vector  field,  where  R  is  the  curvature  tensor 
for  S^. 


Proof.  For  P  as  in  the  theorem,  P  0  on  (/  p  if  and  only 


if  P[p^  e  ]  =  Oon(/p)s^(t)  .  Since  DyW  is  tensor ial  in  V, 

P 


Also,  < 


'P 


>  =  1  implies  ~  ®  ■  Hence 

g  P 


0  =  @[d 


'p 


e  \  eJ 

g  P 


-  Dr  e„  -,e 


’J  “  ^([  ’  "V'  ]]  ■ 


(•: 


since  le^  ,  e^l  =  @[[e^  ,  have  [e^  .  =  0  . 

'S  2 

Therefore,  considering  e  and  as  tangent  vectors  of  S  x{t}  ,  for 

8 


2.3  Parallel  fields,  geodesic  variations  in  images 


gg 


2 

each  point  of  S  x{t>  pj  {/  there  exists  a  coordinate  neighborhood  about 


the  point  such  that  e  and 

g  we 


/S 


are  coordinate  vector  fields. 


From  < 


From  < 


'/3 


r' 


®8 

>  =  1  we  have  < 

la^ll 


,  e  >  =  0  we  have 

S 


,  Df  e 


'jS 


>  =  0  . 


<  e^  ,  Dr  e 


(4) 


'|3 


>  +  < 


>  Df  -.e^  >  =  0  . 


P 

From  (*)  and  Table  1,  < 


s 


'|3 


'P" 


r_ii 

U'V'J 


Consequently, 


r  e 


("V'^ 


=  0  ,  so  that  the  coordinate  corresponding  to  the 


0  2 
coordinate  field  .-j-- -y  is  in  fact  a  geodesic  curve  on  S  x{t>  .  Thus  the 

coordinates  define  a  geodesic  variation  and  the  transverse  field  e 

S 

satisfies  the  Jacobi  differential  equation  (e.g.,  O’Neill  1983, 
Lemma  8.3).  ■ 


The  results  of  this  section  are,  of  course,  only  partial. 
However,  they  do  begin  to  clarify  several  relationships  between 
admissible,  compatible  fields  and  the  image.  We  may  summarize  these 
results  by  saying  that  for  a  sterance  g  ,  for  X  +  hP  admissible  and 
compatible  with  g  ,  and  for  P  parallel  on  (R  -{0>)x{t>  for  all  t  ,  with 
ds  P  =  0  ,  we  understand  the  necessary  and  sufficient  conditions  on  g 


such  that  |p  I  [X+hP](g)=oj 
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2.4  Isometries  for  two-dimensional  distributions 

The  results  of  the  last  section  described  a  restricted  subset  of 
admissible  vector  fields  and  used  only  the  properties  of  the  sterance 
function.  In  this  section  a  larger  class  of  admissible  vector  fields 
is  studied  by  the  Introduction  of  additional  structiare.  As  suggested 
at  the  end  of  Section  2,  the  new  structure  is  Involutive  distributions 
or,  equivalently,  differential  ideals  (Warner  1971,  Ch. 1,  2;  Bishop  and 
Goldberg  1968,  §3.11).  The  vector  fields  to  be  studied  au'e  those  whose 
flows  are  isometries  of  the  integral  manifolds  of  the  distributions. 
Our  first  task  is  to  define  the  differential  ideal  that  is  of  interest. 


16.  DEFINITION.  A  1-form  compatible  with  an  admissible  vector 
field  X  is  a  closed  1-form  u  defined  on  a  neighborhood  U  c  (IR^-{0})xJ 
such  that 

L  about  each  point  im,t)  e  U  there  is  a  neighborhood  V  = 

U  (i^)  in  which  U)  =  dF  ,  F  c  c”(y)  ; 
reR  ^ 


li. 

w(5?)  =  1 

iU. 

o 

II 

3 

This  definition  merely  summarizes  the  situation  in  which  there  is 
a  two-dimensional  submanifold  (surface)  in  (R^-{0} )x{ ,  with  3?  never 
tangent.  Consequently,  there  is  a  coordinate  chart  p  =  (y^.y^.y^.s)  on 
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a  neighborhood  such  that  3^2’ ^3’ ^  coordinate  chart  for  the 

surface.  And,  since  [X,  3i]  =  0  ,  the  inverse  of  the  map 

I - >  ^  coordinate  chart  on  a 

neighborhood.  Let  f  be  the  first  coordinate  function  of  this  inverse. 

Each  level  set  of  f  is  a  submanifold  which  is  tangent  to  X  . 

On  the  other  hand,  directly  from  the  definition  the  1-form  w 

trivially  generates  a  differential  ideal.  Hence,  by  the  Frobenius 

theorem  (Warner  1971,  Theorem  2.32),  through  each  point  (m, t)  of  U 

there  is  a  unique,  msLximal,  connected  codimension  one  submanifold  whose 

tangent  space  is  the  annihilator  of  o)  . 

There  are  the  following  immediate  consequences  of  the  definition: 

^  0)  =  u  ,  hence  L-,a)  =  0  where  La.  is  the  Lie  derivative  relative  to  ; 
r  fR  H 

F°<p^  =  F  ,  hence  =  u  and  =  0  .  Further,  recall,  as  in  Table  1, 

that  ■&*  e^*  =  e^*  ,  [?(,  X]  =  0  ,  hence 
r 

i  ^ 

17.  PROPOSITION.  In  the  expansion  w  =  f  e  ,  where  w  is  a 

i 

1-form  that  is  compatible  with  an  admissible  vector  field  X, 

=  1  and  K(f^)  =  0  ,  i=l,2.3,4  . 

To  construct  a  basis  we  use  the  Hodge  star  operator. 

Qp 

18.  PROPOSITION.  For  a  sterance  g,  dg  -  ~^s  *  0  on  U  = 

U  d  ([/)  ,  for  a  1-form  u  compatible  with  an  admissible  vector  field  X 
reIR  ^ 

defined  on  U,  then  the  differential  1-forms 
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1» 

a 

=  dg  , 

2» 

a 

=  V  = 

3* 

a 

=  u  , 

4* 

a 

II 

a 

constitute  a  linearly  independent  set  of  1-forms  on  U  ,  with 


and 


hence , 


V  =  -  p^f^lim^dlnp  .  =  uie^)  .  =  uCe^)  =  1  , 


•&  V  =  V  , 

r 


j*  a^*  =  a**  ,  i=l,2,3,4  ,  but  (p*  a**  =  a'*  ,  i*2 
r  A 


Proof.  It  follows  from  o>  -  Y,  f  and  from  the  definition  of  p 

1 

(see  Table  1)  that  i>  =  •  a  dg  a  ds)  +  f^p  .  By  the  definition 

of  the  Hodge  star  operator 

<  (y-f  6)  ,  e^*  >  <r  =  pf  ip  a  dg  a  ds  a  e^*) 

3  2 


0  if  i?t3 


-  dpAdgAdSAp  ~  ~  ^2 


The  result  follows  from  lle^*ll^  =  lldlnpll^  =  1/p^  . 

It  is  a  corollary  to  the  proof  of  Proposition  6  that  pll^ll  is 


independent  of  p,  hence  v  =  v 
previous  results  and  definitions. 


The  remaining  relations  are 


1  ^ 

19.  PROPOSTION.  The  properties  of  {a  }  and  the  dual  vectors 


{a  >  for  a  neighborhood  U  =  U  iU)  c  (R  -{0>)x7  are  collected  in  the 
‘  reR  ^ 
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following  table,  where 

D  =  det(a‘*(e  ))  =  f  ^  +  f  . 

J  3  2 

f  =  1  ,  and  He  II  =  lleJl  =  1/11  pll  . 

3  ’  g  p  ^ 


a 


2* 

a 


3* 

a 


4» 

a 


dg 

V 

u)  =  T  f  e^* 
1 
i 

ds 


TABLE  2 


a  =a  =e  -fa 

4  S  S  4  0) 


1? 


1* 

a 


1* 

a 


1* 

a 


i» 

a 


=  0  . 


a  =  a 
r  1  i 


dw  a  =  a 
i  i 


d<p  a  = 


[X,  aj 


<a  ,  a  >  = 
2  i 


,  [3?,a^]  =  0  ,  i=l,2,3,4 

=  ,  1-1,2, 3,4 

0  ,  i  2 


In  particular,  at  each  point  in  U  the  vectors  3^=a^  and 
orthogonal  basis  for  the  integral  manifold  |^o>=0  ,  ds=oj-  , 


a  =a  form  an 
2  V 

and  under  the 


flow  {(p  } 


of  X  the  basis  a 

g 


a^  is  mapped  to  a  basis. 
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Proof.  The  expressions  for  in  terms  of  the  basis  {e^>  is 
obtained  by  inverting  the  matrix  [a  (e^)]  .  Note  that  a  =  a 
implies  L«a  =  0  (Warner  1971,  Prop.  2.25)  and  that  the  converse  holds 

J\  i 

locally.  The  same  holds  for  dd  a  =  a  and  [31, a  ]  =  La,a  .  The 

r  1  1  ’  1  3?  1 

results  for  d<p  a  follow  from  a^  fd<p  a  ")  =  a^  (a  )  .  Similarly  for 

d^^a^  .  The  result  for  [X, a^l  follows  most  simply  from  the  product 
rule  for  X[a'**(a^)]  and  from  a^*[[X,a^])  =  0  ,  j  ^  2,  since  only  v  is 
not  exact  and  since  a  (X)  is  a  consteuit,  ^  *  2.  (It  also  follows  from 
the  derivative  of  dtp  a  with  respect  to  a  .  )  The  orthogonality  result 
follows  directly  by  using  <e^  ,  e>  in  Table  1.  ■ 


We  now  reach  the  motivation  for  the  preceding  constructions.  We 
wish  to  study  X  ,  g  ,  and  w  as  in  the  following  definition. 


20.  DEFINITION.  Let  X  be  an  admissible  vector  field  with  local 
one  parameter  group  <p  ,  where  <p  is  defined  on  U  for  o,  e  J  (0  6  J). 
Let  g  be  a  sterance,  dg  -  ^ds  *  0,  which  is  compatible  with  X  ,  and 

let  u  be  a  1-form  which  is  compatible  with  X  .  We  say  <p  is  an 

-0. 


isometry  of 


if  <p^  is  an  isometry  from  the  integral 


|^c»>=0  ,  ds=o|- 

manifolds  of  ■|^u=0  ,  ds=o|'  q  (/  to  the  integral  manifolds  of  |^w=0  ,  ds=o|- 
Q  U  .  That  is,  <p^  is  an  isometry  if  for  each  (m,  t)  e  U  and  a  e  J 

<  ■  l.J  =  1.2. 

where  a  =a  and  a  =a  as  defined  in  Proposition  19. 

1  g  2  y  ^ 
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The  following  result  provides  several  equivalent  descriptions  of 
an  isometry  of  ,  ds=oj-  . 


21.  THEOREM.  F’or'  ^  local  one  parajneter  group  (p^  ,  defined  on  U 

for  A  €  J  ,  of  an  admissible  vector  field  X  ,  X  compatible  with 

de 

sterance  g  ,  dg  -  -^ds  *  0  ,  and  compatible  with  1-form  w  ,  the 
following  are  equivalent.  For  ^  e  J  ,  (m,t)  e  U  : 


1.  <p  is  an  i 
A 


isometry  of  {‘^O  ,  ds=oj.  . 


X<a  ,  a  >=  0 
g  g 


d<p  a  =  a 
^  g  g 


d<p 


Jlla  II  Ha  II 
u  J  V 


X<ag  .  a^>  =  0 

[x  ,  a  J  =  0 

L  y  -I 


<  D  X  ,  a  >  =  0 


V 


<  D  X  , 
a 

g  V 


,>  +  <  Df  a  -.X  ,  a  >  =  0 
a  II  I  w  1  g 


(n?)' 

y 

For  every  V  e  -|^w=0  ,  ds=o|-  ,  <  D^X  ,  V 

The  (0,2)  tensor  T^  €  T°|^|^w=0  ,  ds=0^j  defined  by 


>  =  0 


T^(F,V)  =  <D^X  ,  W> 


is  skew  symmetric. 
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Proof.  1  2.  From  Proposition  19 


da  a  =  a  +  (p*  i>')  { a  )  a 

8  g  ■>  g  V 

(*) 

dp  a  =  (p*  y")  ( a  )  a 

u  J  y  u 

(»» ) 

(^)  If  ^  is  an  isometry,  then  (<p  i>)(a  )  =  0  since  a  aoid  a  form 

A  ti.  g  8  V 

an  orthogonal  basis.  If  <p  is  sin  isometry  <d(p  a  ,  d<p  a  >  ,  ..  = 

^  g  '  g  tp  {m,t) 


<a  ,  a  >,  ..  . 

8  g  Cm,  t) 


But  C<p  v)Ca  )=0  implies  <d(p  a  ,  d<p  a  >  ,  .. 

■a  8  g  '  g  (p  Cm,  t) 


<a_  ,  a  >  ,  ..  by  (•).  Hence  <a  ,  a  >  ,  is  constant  for  ti.  6 

g  g  (p  Cm,  t)  8  8  <PAm,  t) 

J  ,  thus  X<a  ,  a  >  =  0  .  Finally,  if  ^  is  eoi  isometry,  then  1  = 

—  O  O  -  ^ 


^  V  J  ^  V  J  <p  [m, 

'■  V  ■>  Cm, 


t) 


But  by  (»»)  dp 


(a  )  ,  . 

t) 


Hence 


m  = 


V  p  Cm,t) 


By  continuity  at  =  0  the  right  hand  side  must  be 


positive.  Hence  by  (..)  dcj,^]  =  [if^] 

V  ■'  Cm,  t)  '■  V  •'p  Cm, 


t) 


(<=)  <dp  a  ,  dp  a  >[..  =  <a  ,  a  follows  from 

g  g  p^Cm,t)  g  g  Cm,t) 

X<a  ,  a  >  =  0  eind  from  dp  a  =  a  .  That  dp  preserves  orthogonality 
o  o  ^  S  S  ^ 


is  easy  to  see.  Finally,  <dp  a  ,  dp  a  >  ,  ...  =  II a  Ilf  foil 

V  V  p  Cm,  t)  V  Cm,t) 

directly. 


ows 


2  3.  The  forward  (=»}  case  follows  directly  from  the  definition 
of  Lie  derivative  that  uses  the  derivative  of  with  respect  to  -a.  . 
Conversely,  the  vanishing  of  the  Lie  bracket  implies  that  locally  the 
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corresponding  local  one  parameter  groups  commute,  hence  the  result. 

3  <=>  4.  This  follows  from  the  identity  -  D^X  =  [X, 7]  and 

from  a^*[[X,  a^]]  =  0  ,  i  *  2. 

<D^  X  ,  a  >  =  <Dy3L^  +  [X,a^],a^>  =  (l/2)X<a^  ,  a^>  ; 
g 

a 


<D  X  , 
a 

g 


V 

iialF 

V 


>  +  <D 


X  . 


a  > 


g 


/■a  1 

r  3. 

f 

y 

Ha  II 

’Ha  II 

a  > 
g 


g 


4  ■s=^  5.  4 


clearly  is  a  special  case  of  5. 


And  5  follows  from  4 


by  the  tensorial  property  of  the  covariant  derivative  and  the  fact  that 
a  and  a  constitute  a  basis  for  the  tangent  space  of  the  integral 

g  y 

manifolds. 


5  «=>  6.  This  requires  only  the  application  of  the  polarization 
identity  for  bilinear  forms.  ■ 


A  key  reason  for  considering  only  those  admissible  vector  fields 
which  are  isometries  of  |w=0  ,  ds=oj-  is  that  this  restriction  excludes 

the  type  of  motion  in  which  the  still  picture  condition  is  violated  by 
the  retraction  of  to  the  origin.  (Figure  9) 
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22.  COROLLARY.  (radial  motion)  Let  X  be  an  admissible  vector 

3 

field  on  U  c  (R  -{0>)xl  with  local  one  parauneter  group  <p  ,  EUid  let  X 

de 

be  compatible  with  a  sterance  g  ,  dg  -  ^ds  *  0  ,  and  with  1-form  w  . 

OS 

Let  <p  he  an  Isometry  of  \oy=Q  ,  ds=ol  .  +  5  on  U  ,  X  € 

^  ^  J  3  s  3 

C"(I/),  then  Xg  =  0  on  (7  . 


Proof.  Let  V  be  any  vector  in  -|6)=0  ,  ds=0|-  at  (m,  t)  e  U  such  that 

dX^(V)  =  0  .  Then,  by  statement  5  of  the  theorem, 

0  =  <D^X,l^>  =  <Dy(X^n  +  d^)  ,  V> 

=  <D„(.XJl)  ,  V>  (since  d  is  pEU'allel) 

=  X^  <D^  ,  V>  (since  V(X^)  =  0) 

=  X  Ill'll^  ■ 

3 


A  second  corollary  of  a  similarly  simple  nature  further  clarifies 


those  X  which  generate  isometries  of  |^c<>=0  ,  ds=o|-  . 
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23.  COROLLARY.  (uniform  motion)  Let  X  on  i/  be  admissible  ajid 


let  sterance  g  and  1-form  u  both  be  compatible  with  X  .  Let  <p  be  an 

<1. 


isometry  of 


|w=0  ,  ds=o|- 


If  X  =  hP  +  a 


where 


V 


=  0  for  all  y 


(including  7=3),  then  h  is  a  constant. 


Proof.  By  the  statement  4  of  the  theorem 


0  =  <D,  a  ,(hP  +  aj  . 

M 


=  dh 


Fix  J  .  If  dh 


(4) 


<p  , 


r>  .  J  =  1.2. 


0  at  (m,  t)  ,  then  there  is  a  neighborhood  in 


which  <P  ,  „  •^||>  =  0  by  smoothness  of  P  and  a  .  But  then 
II  a  II  J 

J 


0  =  X<P  , 


la  II 
j 


•>  =  0  +  <P 


<P  ,  D/-  a  ■..X>  =  dh 


[llayi] 


r^i 

lla  II 
J 


\p\\‘ 


which  is  a  contradiction. 


These  two  corollaries  give  some  insight  into  the  permissible  X  . 
They  do  not  depend  on  the  sterance  g  ;  they  depend  only  on  the  isometry 
assumption.  In  the  next  section  the  sterance  is  used  to  clarify  a 
question  of  the  uniqueness  of  X  for  a  given  sterance  and  a  given 


1-form. 
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2.5  Unique  flows 

In  this  section  we  make  explicit  use  of  a  and  a  .  We  recall  a 

g  V 

few  facts  from  Table  2  (in  Proposition  19).  The  vector  fields  a  and 

s 


a  are 

V 


tangent  to  the  integral  manifolds  of  ■|(i)=0  ,  ds=o|-  ;  <a^  ,  a^>  = 


0  ;  and 


dg(a^)  =  1  , 
dg(a^)  =  0  , 


y(a  )  =  0  , 
g 

v(a^)  =  1  . 


That  is,  since  dg(a^)  =  0  ,  a^  is  tangent  to  the  level  sets  of  g  as 
well  as  tangent  to  the  integral  manifold.  This  holds,  by  construction, 


for  any  1-form  u  used  to  define  the  integral  manifold.  On  the  other 


hand,  a  is  tangent  to  the  integral  manifold  but  is  "adjusted"  so  that 

O 

<a  ,  a  >  =  0  .  In  Figure  10  a  sphere  is  illustrated  in  which  the 

o  ^ 

level  sets  of  g  are  lines  of  latitude. 


Figure  10 
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The  next  result  is  essentially  a  continuation  of  Theorem  21. 


24.  THEOREM.  Let  X  be  an  admissible  vector  field  on  U  ,  with  a 
de 

sterance  g  ,  dg  -  *  0  ,  and  1-form  w  compatible  with  X.  Let  {a^} 

^  4*^ 

be  the  vector  fields  dual  to  a  =dg  ,  a  =v  ,  a  =o>  ,  a  =ds  .  With 

the  notation  a  =a  and  a  =a  ,  if  a  flla  11^1  0  ,  then  the  following 

1  g  2  V  g  J  ^ 

are  equivalent. 

1.  The  local  one  parameter  group  of  X  ,  where  defined,  is  an 
isometry  of  |^w=0  ,  ds=0 

2.  X<a  ,a  >  =  Xflla  11^1  =  0 

g  g  ^  g  ■’ 

3.  For  any  sequence  of  vector  fields  d  ,d  ,d . d  ,  where  each 

12  3  d 

a 

d  is  either  a  or  71 — ,  the  function  d  (d  f...d  flla  II  "I... 'll  is 

J  g  lla^ll  d'-d-l'-  g  J 

annihilated  by  X  . 


Proof. 


2.  The  forward  (=>)  implication  clearly  holds,  for, 

a 


and 


by  Theorem  21,  statement  3,  X  commutes  with  both  a  and  7; - rr  , 

g  lla^ll 

X[lla^ll^]  =  0  . 

The  converse  requires  the  additional  assumption  in  the  statement 

of  the  theorem.  For  in  general  [X,  a  ]  =  rflX,  a  l^a  and  X  ,  „  = 

g  t  g  J  y  L  lla^llj 
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•  ^]]  .  But  by  the  conditions  in  2 


rr 

V  1 

1  /•„  „  2\  f 

V  1 

O'V^  “ 

■'ll 

^  ’  Ha  II  1 

V  ■> 

J  5  ■  1 

^  ’  Ha  III 

V  -■ 

If  a^Qla^ll^]  *  0  ,  then  these  two  equations  provide  the  result. 

Statement  3  clearly  implies  2,  euid  it  follows  from  1  by  using  the 

a 

commutativity  of  X  with  both  a  and  7; - r-  .  2md  Xflla  II  1  =  0  .  ■ 

g  lla^ll  *■  g  J 


The  significance  of  the  theorem  is  that  it  provides  relationships 

between  the  vector  field  X  and  the  1-form  w,  for  a  and  a  are  defined 

g  ^ 

in  terms  of  u  .  (Recall,  e  and  e„  are  determined  by  g  alone.  )  The 

g  P 

theorem  is  an  example  of  how  we  are  presently  seeking  to  understand  the 
sense  in  which  the  pair  X  and  u  czin  be  determined  by  g  under  the 
restriction  that  X  generate  an  isometry  of  •^a>=0  ,  ds=0 

The  following  theorem  explains  the  significance  of  the  condition 
that  a^[lla^ll^]  ^  0  .  In  fact,  if  a^[lla^ll^]  *  0  ,  then  there  is  a 
uniqueness  result  that  uses  somewhat  less  than  the  condition  that  X 


generate  am  isometry. 
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25.  THEOREM.  Let  X  be  aji  admissible  vector  field  on  17  c 

3  d  S 

(R  -{0})xl  ,  and  let  g  ,  dg  -  ^  0  ,  be  a  sterance  and  to  a  1-form 

both  of  which  are  compatible  with  X  .  Let  {a^}  be  the  vector  fields 

dual  to  a  =dg  ,  a  =v  ,  a  =(o  ,  a  =ds  ,  with  the  notation  a  =a  and 

1  S 

a^=a^  .  If  XQla^lP]  =  0  (for  example,  if  X  generates  em  isometry  of 
-^w=0  ,  ds=o|-  ),  then  X  is  unique  whenever  a^Qla^ll^]  ^  0  on  17  . 


Proof.  Since  a^*(.a^)  =  5^^  ,  the  four  1-forms  dg  ,  d[lla^ll^]  ,  to  , 

ds  are  linearly  independent  if  and  only  if  a^Qla^ll^]  *  0  .  Since 

(a  and  are  determined  by  g  and  to,  then  the  four  vector  fields 

dual  to  dg  ,  d[lla  11^]  •  .«  >  ds  au'e  determined  by  g  and  to  .  In 

particular,  X  is  so  determined  since  dg  X  =  d[lla  11^]  X  =  w(X)  =  0  and 

S 

ds(X)  =  1  .  ■ 

26.  COROLLARY.  With  the  conditions  as  in  the  theorem,  since  to  = 


dF  locally,  the  functions 

=  g  .  = 

Ha  11^,  y  = 
g  ^3 

F  , 

^4  = 

s  are  a 

coordinate  system 

for  (7  c 

(R^-{0>)xI  . 

For  this  coordinate  system  X  = 

,  the  slices 

h  ■ 

Xg  .  y3=const 

,  y^=constj- 

are 

the 

integral 

manifolds  of  -|^w=0 

,  ds=oj 

^  d  d 

’  dy^  ’  ay. 

-  are  tangent 
2 

to  ■( 

|^w=0  , 

,  ds=o|-  . 

This  theorem  can  be  compared  to  our  result  in  Chapter  1,  Sec.  4. 

3 

There  we  had  a  uniquely  determined  sequence  of  submanifolds  of  R  ,  but 
no  canonical  way  to  define  a  flow  that  generated  this  sequence.  This 
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theorem  says  there 

a  flla  ll^l  0  . 
ut  g  J 


is  at  most  one  flow  that  preserves 


lla  11^ 
g 


if 


It  is  easy  to  see  that  the  condition  a^flla^ll^]  ^  0  is  necessary. 
In  fact,  a  proof  by  picture  is  already  available  in  Figure  10.  If  the 
level  sets  of  g  correspond  to  lines  of  latitude  on  the  sphere,  then 
a^Qla^ll^]  =  0  .  Any  rotation  of  the  sphere  about  the  north,  south  axis 
is  compatible  with  g  and  with  the  1-form  w  that  characterizes  a 


stationary  sphere. 


PART  2 


SOME  SOLUTION  TO  PROBLEMS  IN  VISION 
FROM  DECONVOLUTION  METHODS 


3  DECONVOLUTION  FOR  THE  CASE  OF 
MULTIPLE  CHARACTERISTIC  FUNCTIONS  OF  CUBES  IN  R"" 


Summary 

Explicit  error  bounds  are  exhibited  for  a  case  of  deconvolution 
with  elementary  convolutors  on  r".  The  convolutors  studied  are  a  set 
of  n+1  characteristic  functions  of  cubes  (  e.g. ,  with  side  length  ■/]  , 
j=l,  2, . . . n+1)  which  operate  by  convolution  on  L^nL^(R"),  For  a 
suitable  choice  of  approximate  identity,  a  set  of  n+1  functions 
(deconvolutors)  in  L^(!R")  are  exhibited  which  restore  up  to 
convolution  with  the  approximate  identity,  from  the  n+1  convolutions. 
For  the  case  of  the  convolutors  operating  on  L^nL^nL^(R") ,  l^p<oo, 
explicit  bounds  for  the  restoration  error  in  the  norm  L^{E),  E  compact, 
are  exhibited;  that  is,  error  bounds  for  restoration  restricted  to  a 
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IIB 


Summary 


compact  subset.  The  motivation  for  this  study  is  the  digital 
implementation  of  this  deconvolution  for  the  application  to  signal 
detectors  which  act  by  integrating  over  cubic  regions.  This 
motivation  is  discussed  along  with  remau'ks  on  the  significance  of  the 
topology  for  signals  that  is  Implied  by  the  notion  of  restoration  or 


deconvolution. 
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3.1  Introduction:  deconvolution  and  machine  vision 

Our  interest  in  deconvolution  is  in  part  a  consequence  of  a  point 
of  view  in  machine  vision  that  we  have  been  developing.  (For 

contemporary  developments  in  machine  vision  see,  for  example,  Marr 
(1982).)  In  this  introduction  we  shall  indicate  this  point  of  view  and 
we  shall  also  indicate  certain  constraints  to  deconvolution  that  arise 
in  machine  vision. 

The  deconvolution  problems  that  are  of  interest  here  are  of  the 

type;  on  r",  given  N  distributions  of  compact  support  . 

(called  convolutors) ,  determine  the  existence,  support,  and 

construction  of  N  distributions  v  ,v  (called  deconvolutors) 

12  N 

such  that 


N 


where  5  is  the  Dirac  distribution. 

2  3 

For  machine  vision  the  interest  is  in  R  or  R  .  Existence  of  the 

deconvolutors  depends  on  the  e.g.  ,  the  cannot  all  be  smooth 

(C  )  functions.  A  condition  can  be  placed  on  the  p^,  called  strong 

coprimeness,  such  that  the  desired  exist  and  have  compact  support 

(Kelleher  and  Taylor  1971).  The  cases  for  which  the  p^  are 

characteristic  functions  of  a)  two  intervals  on  R  and  b)  two  disks  on 
2 

R  have  been  examined  in  Berenstein  and  Yger  (1983)  and  in  Berenstein, 
Taylor,  and  Yger  (1983a,  1983b).  For  these  cases  deconvolutors  with 
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compact  support  exist  when,  for  example,  two  interval  lengths  or  two 
disk  diameters  have  the  ratios  VS  or  2,  respectively.  Explicit 
formulas  for  the  deconvolutors  in  cases  a)  are  reported  in  Berenstein, 
Krishnaprasad,  and  Taylor  (1984). 

Let  us  consider  a  role  for  deconvolution,  or  signal 
reconstruction,  in  machine  vision.  In  machine  vision  One  seeks 
information  about  objects  by  meams  of  one  or  more  images.  Let  us 
consider  objects  that  can  be  modeled  as  a  finite  union  of 


2-manifolds  M  in  IR  . 
J 


An  emitted  or  reflected  radiation  can  be 
associated  with  an  object  by  defining  a  density  F  on  the  sphere  bundle 


of  IR  restricted  to 


yWj,  ,  where  the  density  is  with  respect  to 


a  choice  of  volume  form  for  SIR" 


r> 


To  include  the  variable  time  we 


consider  the  product  space  SIR  |y^  xIR.  Let  M  denote  a  subset  of  the  set 

J  J 


of  such  densities  along  with  their  support 

,3. 


M  c  {F  :  SIR  xIR 
ii 


IR>. 


2 

Let  denote  a  subset  of  R  .  This  subset  will  represent  what  is 

typically  referred  to  as  the  "image  plane."  Let  ?  denote  a  subset  of 

the  set  of  time  varying  image  densities 

?  c  { f  ;  £  xR  — >  R}  . 

2 

A  basic  problem  in  machine  vision  is  the  definition  and  construction  of 
a  suitable  left  inverse  p  of  an  image  forming  map  p, 

_P  > 

M  f  . 

< - 

P 

Additionally,  and  most  importantly,  appropriate  topologies  are  sought 


3.1  Introduction 


119 


so  that  p  is  continuous.  For  example,  if  .K  is  a  finite  set  with  the 
discrete  topology,  then  ^  should  consist  of  disconnected  components, 
each  containing  at  most  one  point  from  p(M),  and  on  each  component  p.  is 
constant.  If  pirn)  is  in  component  C  then  the  convolution  <p»p(m)  of  a 
given  function  <p  with  pirn)  may  not  be  in  C.  In  this  example,  the  role 
for  deconvolution  is  to  map  <p»p(m)  back  to  C.  Since  we  require  only 
that  the  deconvolution  yield  a  point  in  a  neighborhood  of  pirn),  we  use 
the  term  approximate  deconvolution. 

We  shall  leave  further  mathematical  details  on  this  point  of  view 
to  a  future  paper,  but  we  will  discuss  the  motivation.  The  motivation 
is  that  we  wish  to  consider  separately  the  questions  of  image  quality 
and  the  questions  of  machine  vision,  and  then  to  Join  these  questions 
throught  continuity  of  vision  on  an  appropriate  space  of  images.  We 
separately  consider  these  questions  because  it  seems  ill  advised  to 
address  the  issue  of  vision  over  some  neighborhood  of  an  image  (which 
might  include  the  image  plus  some  additive  noise,  convolutions  of  the 
image,  or  non-linear  sensor  degradation  of  the  image)  when  the  issue  of 
vision  at  the  idealized,  perfect  image  remains  an  open  question.  With 
this  separation,  we  consider  the  idealized,  perfect  image  (e.g. ,  pCm) 
for  m  e  M)  as  a.  limit  point  in  an  appropriate  function  space  ?,  and  we 
shall  require  that  ary  well  defined  vision  algorithm  p  be  continuous  on 
this  space.  (An  exajnple  of  a  topology  for  M  is  the  smallest  topology 
such  that  p  is  continuous. ) 
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We  now  turn  to  the  specific  issues  in  image  quality  and 

convolution-deconvolution  that  are  the  subject  of  this  paper.  For  any 

image  f  e  ?  we  never  know  f:  we  measure,  for  example,  Sf  ,  where  Q  is 

Q 

a  neighborhood  of  (0,0)  €  E^xIR,  instead  of  f(0,0).  To  use  our 

continuous  vision  algorithm,  if  we  cannot  know  f  then  we  would  like  to 

be  sufficiently  close  to  f.  Let  us  consider  2ui  ex^Lmple  of  what  we  can 

know  about  f.  The  set  Q  could  be  ^]x(-T,  0) .  That  is,  Q 

models  a  square  detector  of  side  length  a  >  0  centered  at  0  e  c 

and  which  integrates  over  the  time  interval  (-T,0),  T>0.  Let 

A  =  [-|.|]x[-|,|}x(;0,T]  =  {x  :  -X  €  Q}  =  -Q, 

and  let  be  the  characteristic  function  of  A.  Then 

=  [%^»f](0,0). 

Q 

Let  us  model  a  staring  array  with  a  simple  integration  time 


response.  A  set  of  non-overlapping  subsets  which  covers  (up  to 

Lebesque  measure  zero)  is 

{^P.q  =  ^  C-|%a  ,  l+p^a]  X  [(q-l)T  .  qT]  : 

p=ip^.p^)el^  .  qezj. 


Let  each  Q  model  a  square  detector  of  side  length  a  centered  at  pa  = 
(p^a,  p^a)e£^  which  integrates  over  the  time  interval  [(q-l)T  ,  qT] . 
M  shift  of  X,  by  (u, s), 

A*'  I  ( u ,  s ;  J  A 

With  this  .and 

Piq 
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For  the  staring  array  we  do  not  measure  fe?  but  rather 

(pa,  qT)  :  peZ^  ,  qeZ  ,  (pa.qDeEl 


{c^ 


J 


where  £  is  some  bounded  subset  of  £  xK. 

2 


An  answer  to  the  question  of  what  cam  be  said  about  f  based  on  the 
measured  data  is  that  for  /  in  a  suitable  choice  of  normed  function 
space,  these  meausred  values  can  be  used  to  approximate  x  [x  by  the 
interpolation 

Pi  q 

where  >Jt  is  a  choice  of  interpolating  function  (e.g.  , 

p.q 

0  =X  (x-pa,t-qT)  ).  Moreover,  for  suitable  normed  spaces,  %  fy  *£1 

p,q  0  E A  y 

approximates  For  a  choice  of  A  let  3  denote  the  set  of  all 


interpolations' 


^  0^^^  :  f  6  A 

^  p  1  q 


tN 


Let  }  denote  the  direct  product  of  N  such  sets,  in  each  of  which  a 
different  characteristic  function  is  used, 

I  c*.  A- 

1=1  '■  p,q  i  ■' 

Thus,  what  is  known  about  f  is  a  set  of  approximating  interpolations  of 
approximating  convolutions. 

We  summeirize  the  above  by  the  diagram 

P  . 


M 


f 


r 
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The  relations  p.  emd  p  zu'e  between  objects  and  images  in  the  sense  we 
have  modeled  them  above.  The  map  r  is  the  composition 
interpolation  «  sample  o  convolution 


just  discussed. 

The  map  n.  is  the  subject  of  this  paper.  For  a  given  choice  of 

norm  on  5,  a  is  a  map  from  r(f),  fe?,  to  am  approximate  reconstruction 

of  f.  This  may  be  viewed  as  a  numerical  implementation  of  the 

deconvolution  from  -Ir  to  f,  for  the  reconstruction  is 

r\  J  1=1,2..... H 

based  on  a  finite  set  of  values  from  the  convolutions.  The  existence 

and  continuity  of  the  operator  which  deconvolves  -Iz  is 

J  1=1,2, ;  .  .  ,K 

discussed  later.  Given  this  operator,  its  continuity  permits  us  to 
discuss  approximate  deconvolution  based  on  approximations  of  x  t>y 

A 

I 


interpolation. 

We  now  turn  to  a  second  item,  certain  physical  constraints  on 
deconvolution.  Let  A,  Q,  A  .  E,  aind  f:E  xR  - >  R  be  as  above. 

p,q  2 

It  has  already  been  suggested  that  the  set  {A  }  is  to  be  a  cover 

p,q 

of  fgXR  by  non-overlapping  sets.  Recall 


p,q 


The  physical  constraint  is  that  Q  nQ  ,  ,  =  0  for  (p,q)  *  (p',q'). 

p,q  p  ,q 

This  is  because  two  detectors  cainnot  occupy  the  same  space 

simi Itaneously.  This  constraint  can  be  modified  (e.g..  using  beam 

splitters)  such  that  the  constraint  is 

5^  c(p.q);t^  (x.t)  =  1 

p,q  p,q 
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2 

where  c:Z  xZ  — >  [0,1].  For  the  staring  array  exajnple,  c  =  1.  (Here 
we  do  not  include  detector  efficiency  in  our  discussion. )  This 
constraint  will  determine  in  part  the  “observation  points,"  that  is, 
points  at  which  can  be  evaluated.  For  example,  the  set 

:  P  e 

is  not  physically  realizable  for  3  <  a  . 

In  addition  to  constraints  on  the  points  at  which  x  (x  *fl  is 
measured,  we  also  have  bounds  on  the  measured  values.  From  Holder’s 
inequality 


i^ECV^^ioo  -  II^aIIp  i^ip'  ’  I  ^  • 

Let  |A|  be  the  three  dimensional  Lebesgue  measure  of  A,  i.e.,  |A|  = 

Thus 


Xjl,  = 


and  for  p  <  oo  ,  f  e  (R  ), 


|A| - ^ 


0. 


(For  p  =  00  and  for  f  e  L  (R  ),  we  get  pointwise  convergence  by  the 


Dominated  Convergence  Theorem,  [%  rz»f1](x,t) 

E  ^  A  ^ 


|A| - jO 


-4  0.  ) 


In  the  case  where  noise  or  errors  for  each  measurement  do  not 
decrease  as  |A|  and  for  f  with  unit  L**  norm,  we  have  a  lower  bound 
on  1A|  imposed  as  an  addition  constraint. 

2 

For  A  as  above,  the  simplest  pattern  of  observation  points  in  R  xR 
is  the  staring  array  with  simple  integrator. 
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See  Figure  11.  With  |A|  =  a^,  we  may  rescale  a  2uid  T, 

A(s)  =  [-s|  ,  X  [-s|  ,  s|]  X  [O  ,  ,  s>0  , 

so  that  |A(s)|  =  1A|  =  a^.  See  Figure  12a  and  12h.  In  other  words, 
the  detector  size  can  be  reduced  if  the  integration  time  is 
appropriately  increased,  and  visa  versa,  without  altering  the  upper 
bound  due  to  Holder. 

A  second  simple  observation  scheme  is  a  continuous  scanning 

2 

pattern.  Let  v  be  a  unit  vector  in  IR  and  define 

B  =  |(x,t)  e  Ir\[O.T]  :  x-vt  €  [-|,  |]  x  c 

See  Figure  13.  Note  that  |B|  =  |A|. 

A  third  scheme  is  an  alternative  to  the  continuous  scan,  the  shift 
scanning  pattern  of  Figure  14. 

In  all  of  these  cases,  the  number  of  observation  points  in  a  fixed 
set  E  c  is  approximately  \E\/a^.  We  have  here  the  "mesh  size"  or 

sampling  interval  bounded  below  due  to  a^. 

Let  us  examine  the  consequences  of  f  being  independent  of  time. 
Let  f(x,t)  =  g(x),  and  let  P(l/n)  =  x  ^ 

For  the  rescaling  case  of  the  staring  array 

(x  *fl(x,t)  =  \  (x  X  2  l»fl(x,t) 


[t-n  T,t] 

2., 


=  a  T  n 


'•Pd/n) 


II  1C 


g]  (x). 


P(l/n)  1 
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1 


(pa, 0) 


Fig.  11.  Representation  of  a  staring  array  with  a  simple 
integration  time-response. 
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Fig.  12.  Two  rescalings  of  a  and  T 


|A(1/2)|  =  |A(2)| 


3. 1  Introduction 


127 


/  /  / 
/ 


Fig.  13.  Representation  of  continuous  scanning  with 

2 

scan  velocity  v  €  R  .  In  this  representation 
■fpa+vT  :  p  e  2^1  =  i^pa  :  p  €  2^1  . 
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Numbers  at  points  refer  to  value  of  j  for  which  sampled. 
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The  observation  points  are  [p^, qn^)  ,  peZ^  ,  qeZ,  and 


a^ 


(i 


^P(l/n) 


\x 

^P(l/n) 


1 


« 


We  conclude 

Remark  1  For  rescaling  of  A  to  A(l/n),  and  for  g  e  L*’(IR"),  lsp<oo, 

a)  The  underlying  convolution  which  is  sampled  converges  in  to 
g  as  n  Increases: 


f  ^P(l/n) 

- ir  *  ^  — 

'■  ^P(i/n)  1  n 


-»  u^g  in  : 


b)  the  number  of  observation  points  on  any  set  increases  as  n^; 

c)  the  time  interval  associated  with  each  observation  point 
Increases  in  length  as  n^. 

For  shifted  scanning,  a  choice  for  an  observation  point  set  is 

|C^Pj.P2)a  +  J(^.  ,  JT]  :  (p^,p^)eZ^  ,  Jezj, 

whereas  the  set  A  remains  the  same  for  any  n.  See  Figure  15. 
Moreover, 


{C^a»^3  [pa  +  Ja(l,  (i)^)  ,  JT]  :  peZ^  ,  Jezj 

=  :  PeZ^  .  Jez} 


We  conclude 

Remark  2  For  shifted  scanning  according  to 

I [pa  +  Ja(i  (i)^)  ,  jT]  :  peZ^  ,  Jezj 


a)  the  underlying  convolution  remains 


3.1  Introduction 


131 
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a  -  ; 

b)  the  number  of  observation  points  on  any  set  increases  as  n  ; 

c)  the  time  required  to  acquire  a  full  observation  set  increases 

as  n  . 

Let  us  compare  rescaling  (Remark  1)  and  scanning  (Remark  2).  For 
fixed  and  for  f  independent  of  time,  to  reduce  the  mesh  size  of  the 
observation  points  projected  onto  E^,  we  can  use  smaller  detectors  and 
observe  over  a  longer  time  interval,  or  we  can  use  (shifted)  scanning 
and  a  sequence  of  time  intervals.  In  both  cases  |A|  =  and  the  total 
observation  time  to  get  all  observation  points  is  the  same.  Therefore, 

1.  Rescaling  and  scanning  are  equivalent  in  terms  of  observation 
time  required.  However, 

2.  Rescaling  and  scanning  differ  in  that 

a)  rescaling  uses  decreasing  detector  size  to  approach  the 
desired  function  g, 

b)  scanning  uses  a  fixed  detector  size  to  approach  Xp*S- 

Our  interest  is  in  the  scanning  case.  In  particuler,  we  examine 
the  case  of 

I.  :  J  ^  4 

that  is,  more  than  one  detector  of  fixed  but  appropriate  sizes  and  a 
sequence  of  observation  points  whose  mesh  size  can  be  as  fine  as 
required.  For  such  a  case,  the  desired  approximate  reconstruction  of  g 


can  be  given. 
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3.2  Construction  of  an  approximate  deconvolution  on  r" 


While  we  shall  address  in  detail  the  case  in  which  the  convolutors 

are  the  characteristic  functions  of  cubes  in  r"  (e.g. ,  the  cubes  P^, 

P  ,  and  P  in  R  mentioned  just  above),  we  may  begin  somewhat  more 

2  3 

generally.  Specifically,  we  shall  assume  we  are  given  N  convolutors 
i=l,2,...Af,  and  each  is  in  l"(r”)  auid  has  compact  support.  Let 
f  be  in  L^nL*”(R").  We  wish  to  approximately  reconstruct  f  from 

r(f)e^  ,  where  r  and  ^  are  as  in  the  Introduction  of  this  chapter. 
Approximate  will  mean  any  of  the  norms,  lsp<oo  (and  p=co  with  some 
additional  qualifications). 

For  approximate  reconstruction  of  f  it  suffices  that  for 
sufficiently  large  t,  t>0,  the  reconstruction  approximate  <P^»f,  where 
(p  e  L^(r”)  and  =  t"^(tx)  for  x  e  r”,  since 

^  »f  - >  f  in  l'’(r"),  lsp<oo  . 

In  this  case  we  seek  N  deconvolutors  v  ,v  such  that 

12  N 

N 

1 =1 


The  ingredients  for  a  solution  {v  »<p  }  were  noted  by 

Berenstein,  Krishnaprasad,  and  Taylor  (1984).  Let  ^  denote  the  Fourier 

transform.  The  Fourier  transform  of  distributions  in  the  equation 
N  N 

y  p  »v  =5  results  in  the  Bezout  equation  V  ji  y  =  1.  A  necessary 


i=i  1=1 

condition  on  (u  } 

1  1=1 . N 


for  the  existence  of  a  solution  is  thus 


3.2  Construction  of  an  approximate  deconvolution 
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N  N 

^  l^ij^(w)  >  0  for  all  w  e  R".  For  such  a  solution  of  ~  ^ 

1=1  ‘ 


1  =1 
is 


A 


D  = 
1 


Il». 


A  .2 


1  =  1 


where 


denotes  complex  conjugation. 


However,  the  D  are  not  the 
1 


solutons  if  each  is  to  be  a  distribution  with  compact  support, 
for  the  are  not  analytic.  On  the  other  hand  we  have  the  following. 


For  u  =  (ti)  ,w . u  )  let 

12  n 


Hull  = 
00 


max 

J=l,2,  .  . .  ,n 


The  growth  of  D  as  Hull  gets  large  is  known  once  a  lower  bound  is 
1  00 
N 

established  for  )  Ip  r(u).  For  the  p  of  interest  we  shall  exhibit 
1^1  ‘  ‘ 

such  a  bound  as  well  as  a  choice  of  (p_^  such  that  e  L^(r”).  In 

this  case  there  exists  h  e  L^(R")  such  that  fi  =  D  (p  and 


1  T 


1  =1 


this  last  equation  easily  seen  by  taking  Fourier  transforms.  (We  have 


assumed  f  e  L^(r")  so  that  p^*f  e  L^(R")  and  the  left  hand  side  is  in 

L^CR”). ) 


The  {h  }  are  the  desired  approximate  deconvolutors. 

1  1=1, . . . ,N 

However,  they  do  not  have  compact  support.  On  the  other  hand,  they  can 
be  explicitly  exhibited  using  only  the  knowledge  of  the  Fourier 
transforms  of  the  convolutors  p^.  Because  of  this  simplicity  and 
potential  utility,  in  the  following  we  conduct  an  error  analysis  for  a 
digital  implementation  of  this  approximate  deconvolution  for  the 
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special  case  of  convolutors  which  are  characteristic  functions  of  cubes 
in  r”.  In  addition  the  cases  described  in  the  introduction  provide  two 
further  restrictions  on  the  problem  and  these  we  adopt. 

First,  it  will  suffice  to  approximately  reconstruct  f  on  some 
compact  set  E.  For  example,  it  suffices  to  choose  t  such  that 

e,  =  Wx^if  - 

is  sufficiently  small. 

Second,  the  measurements  consist  of  a  discrete  set  in  R"  on  which 

a  set  of  convolutions  is  evaluated.  Let  {x  >  _  denote  the  discrete 

q  qeO 

set  of  points,  with  x  e  R”  and  with  Q  a  finite  index  set.  The 

q 

convolution  values  are 

|[M^»f](x^)  :  qeQ,  i=l, 2, ..., iv|. 

We  seek  to  use  these  values  to  approximate  f  on  £  by  constructing 

an  interpolation.  In  particular  we  seek  functions  ^^rR"  — >  R,  j  e  J 

c  Q,  and  we  seek  a  map  G:{x  }  ,  ,  — >  R  such  that  x  =  X  Y.  and  x  f 

J  JgJ  j  } 

is  approximated  in  hy  x  D  G(x  )*{)  .  That  is,  we  seek  to  make  the 

J  J 

error  e  , 


c  =  -  I  G(x  )^  ] 

jeJ  ^  ^ 


sufficiently  small. 


For  brevity  let  F  denote  <p  »f  .  From  above  we  have 

H 


F  s  ^  . 


1=1 
v 

Let  denote  inverse  Fourier  transform,  let  x-,  be  the  characteristic 

A 

function  of  the  set  {ueR"  :  Hull  ,  and  let  S  be  a  compact  set  in  R" 

00 
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with  characteristic  function  •  Then  define 


We  shall  seek  to  choose  A  and  2  such  that 

is  sufficiently  small. 

The  triangle  inequality  now  indicates  the  additional  two  terms 
needed  to  have  a  bound  for  c.  One  term  is 

S  =  i^E  > 

jeJ 


and  the  second  term  is 


^  =  i^E  • 

The  defining  expression  for  G  above  suggests  the  consideration  of  G(x^) 
of  the  form 

N  ^ 

S(x )  =  y  (x  -  X  )rp  »f)(x )  , 

1=1  geQ  J  H 

where  H  :{x  }  „  - >  R  .  The  H  then  are  the  deconvolutors  which  we 

i  q  qeQ  i 

shall  implement.  An  error  bound  for  this  approximation  is  thus 

=  \\\  [f  -  I  S(X  )^  ]|1  ^  • 

jeJ 

In  the  following  we  develop  bounds  for  each  of  the  four  error  terms. 
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3.3  The  lower  bound  C(w) 

For  a  choice  of  n+1  positive  numbers  a  ,a  let  A  be  the 

0  1  n  1 

cube  of  side  length  a  in  R".  Let  x  be  the  characteristic  function 

*1 

X 

of  A  and  let  u  =  -  .  For  this  specific  case  of  convolutor  we 

i  ,  .n 

(a  ) 

shall  prove  the  following. 

1.  THEOREM.  (Berenstein)  Let  a  ,a . a  be  a  choice  of  n+1 

0  1  n 

positive  integers  such  that  the  collection  is  pairwise  relatively  prime 

and  none  is  a  perfect  square.  Let  a^  =  v'cP  ,  and  let  M  = 

max  {a^}.  Let  be  the  characteristic  function  of  the  cube  in  R" 
1=0, 1 ,  . . .  n 

with  side  length  a^  normalized  to  unit  norm  as  above.  Then 


The  proof  will  follow  from  several  lemmas.  We  begin  with 


2.  LEMMA.  Let  p  and  q  both  be  postive  integers.  If  p  and  q  are 


relatively  prime,  then  Vp/q  is  rational  if  and  only  if  both  p  and  q  are 


perfect  squares. 
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2  2 

Proof.  («=)  Clear.  (=>)  It  follows  from  qr  =  ps  for  some 
relatively  prime  integers  r  and  s,  from  a  prime  factor  expansion  of  q, 

m  m 

1  k 

q  =  q^  ,  and  from  the  fact  that  p  and  q  are  relatively  prime, 

that  each  q  divides  s.  Hence, 

2n  2n 

=  q^  ^  -  -  *'(s'  ,  2n^  £  for  i=l,2,  .  .  .  ,k. 

If  q  is  not  a  perfect  square  then,  reordering  factors,  is  odd, 

2  2  2  2 
2n^-fl2^  ss  1,  hence,  from  qr  =  ps  ,  q^  divides  r  as  well  as  s  .  This 

contradicts  r  and  s  being  relatively  prime.  This  along  with  a  similar 

argument  for  p  show  that  both  p  and  q  are  perfect  squares.  ■ 


To  proceed  it  will  be  necessary  to  define  some  maps.  Let 
{a,a,...,a},  di=  min{a  >.  Let  xelR.  Define  the  maps 


0  1 


a  €«{ 

i 


by 


d;  IRxj4 


X  =  d(x,a  )  -  +  r(x,a  ), 
i  a  1 

1 


r:  IRxj4 


[-—  — ] 

^  2m  ’  2m^ 


sgn(x)  r(x,a^)  e  [-^  ). 

i  i 


For  fixed  x  we  have  the  maps  defined  by  restriction 

>  I. 


d  :d 

X 


r  -.4 

X 


[-—  — ] 

^  2m  ■  2m^ 


d  (a  )  =  d(x, a  ) 

X  i  i 


r  (a  )  =  r(x,a  ), 

X  i  i 


For  each  fixed  xsR  we  also  define  the  subset  F  c  4  hy 


r  =  e  4  :  [r  (a)  |  =  min{lr  (a  )!}]-. 

^  I-  a  *  J 

1 


A  choice  from  F  will  be  denoted  y  .  (The  set  F  may  consist  of  more 

X  XX 

than  one  element.  Any  element  y  may  be  interpreted  as  an  element  of  4 


for  which  some  integer  multiple  of  nZ-y  is  as  near  x  as  any  element 

X 
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from  the  set  {z—  :  zeZ  ,  a  eitf} .  ) 

a  1 

i 

The  following  simple  observation  will  be  used.  Its 
directly  from  the  definition  of  y  . 

X 


3.  LEMMA.  For  every  Q  a  0  either 

|r  (r  )|  ^  Q 
or 


for  every  a  e  j4,  r  (a  )  >  Q  . 

1  X  i 


4.  LEMMA. 
6  e  Z  {0>, 


For  every  a^, 


a  e  4  such  that  a 
J  I 


*  a 


[44I16I  *  ija/ 


Proof.  There  exists  a  nonnegative  integer  n  and  e 
such  that 

a 

— -|6|Tr  =  nn  +  cn  . 
a 

J 

From  this  and  the  properties  of  the  sine  function 
|sin^-^7rj  I  =  |sin^-^|6|7rj  I  =  |sin(eTr)|  a 


From  (*) 


proof  follows 


and  for  every 

i  [-1/2  ,  1/2] 

(*) 

( •• ) 

( •»» ) 


This  cannot  vanish,  for 
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*.2  2  „ 

0  -  n  =  0  <=» 


aj  -  161  ' 


hence  -  is  rational,  which  by  Lemma  2  contradicts  the  intial 

a 

J 

2 

assumptions  for  A.  This  nonvanishing  along  with  the  fact  that  eind 

2  2  2  2  2 1 

are  both  integers  impiies  |a^  6  -  n  a^  |  a  i.  This  with  (**») 


implies 


IcttI  a 


a 

a  ^  — ^1  6  I  +  n 

J  "j 


C*  A 

1  1 

However,  from  (•)  n  s  - 16|  +  5-  ,  hence 

di  £* 

J 


di  di  di 

^161  +  n  s  -^161  +  -^161  +  i  , 
a  a  a  2 

J  J  J 


consequently 


letrl  a 


which,  when  substituted  in  (*•),  yields  the  desired  inequality. 


Recal  1  Af  =  max{  a> . 

a€^ 


5  LEMMA  Let  x  e  R  be  fixed.  For  every  y  e  F  ,  if 

X  X 

Id  (y  )  1  2:  1 

'  X  X  ' 


^  H  ^  I 

XX  fl 


-Id  (y  )|  +  1  y  ^ 

XX  X 
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then  for  every  a  *  y 

i  X 


sinCa^x) I  a 


-  l]»/  *  i]^ 


Proof,  Since  x  =  ^  Mean  Value  Theorem 

X  X  XX 

X 

there  exists  ^  €  IR  such  that 

sinCa^x)  =  sin|^-p^^(y^)rt  +  =  sin  +  a^r^(y^)cos?. 


sin(a^x) |  £  |s 


(apply  Lemma  4) 


^-F 

V 


-  a  |r  (y  ) 

1  X  X 


Id  (r  ) I  +  1 

X  X 


(apply  the  hypothesis) 


r  ^ 


Id  (r  )l  +  1  y  " 

XX  X 


"  K 

V 


Id  (y  ) I  +  1 

X  X 


«  -  - 

X  X  ^ 


The  next  two  lemmas  will  address  the  case  |x|  £  n/2M.  For  this 


case  the  condition  d  (y  )  £  1  is  not  vacuous. 

X  X 
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6.  LEMMA.  If  1*1  a  n/2M  ,  then  there  exists  e  such  that 

Id  (r  )|  2:  1. 

'  X  X  ' 


Proof,  a)  Case  x  =  n/2M. 

Since  x  =  n/M  -  n/2M  ,  then  d  (H)  =  1  and  r  (W)  =  -n/2M.  Moreover,  for 

X  X 

all  a  *  M,  X  <  n/2a  ,  hence,  d  (a  )  =0  and  r  (a  )  =  n/2M  ,  therefore 

i  i  X  i  X  i 

|r^(M) I  i  |r^(a^) | ,  or  M  e 

b)  Case  x  =  -n/2M. 

Use  an  analogous  argument  with  d  (M)  =  -1,  -  n/2W,  and  for  *  H 

r  (a  )  =  -n/2M. 

X  i 

c)  Case  |x|  >  n/2M. 

Consider  any  y  e  f  .  Since  x  =  d  (y  )-  +  r  (y  )  whereas  |r  (y  )  ]  s 

XX  X  X  y  XX  'XX* 

X 

|r^(W)  I  2S  n/2M  <  |x|,  then  -  I-  ■ 

7.  LEMMA.  If  lx|  ^  n/2M  then  there  exists  y  e  si  such  that  for 
every  a  6  s4  -  {y  > 

1  X 

|sin(a  x)| 

_  >  _ 

|a^x|  5|x|^W^ 


Proof.  Fix  X  e  R  ,  |x|  i  n/2H.  Lemma  6  provides  ay  e  F  such 

X  X 


that 


X  =  d  (y  )-  +  r  (y  )  ,  Id  (y  ) I  a  1  . 

X  X  y  XX  '  X  X  ' 

X 

1 

Since  |r  (y  )|  :£  7r/2y  ,  then  |x[  a  f|d  (y  )  |  -  srlTt/y  .  Therefore, 
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1 

1  -  a)"''*'. 

r  A  1 

4^|d  (r  )l  +  1 

1  ^  ^  J 

The  right  hand  expression  is  increasing  in  I  I  ~ 

so  we  may  use  |  =  1  to  get  a  lower  bound: 

_ 1 _  >  J _ ^ _  a  J _ a  J - . 

LAidtr  )l  .  il  Ixl4«*r,  Ul  5« 

I  y  X  X  J 

By  Lemma  3  it  suffices  to  consider  two  cases. 
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2 

IsinCa  x)  I  =  IsinCa  r  (a  ))  I  2:  —  Ir  (a  )  la 

'  i'  ‘  Ixl'  TT'xl'l 

2a^  2  1  2a^  2  1  n/2  1 

-|-|d  (y  )l  +  1 

y  X  X 

X 

which  implies  the  desired  result  (recall  y  sW).  ■ 

X 

Remark:  In  Case  2  a^x  is  never  an  interger  multiple  of  n.  In  Case  1 

a  is  used. 

l  X 

The  case  lx|  ^  n/2M  is  addressed  next.  As  usual  sin(x)/x  is 
defined  to  be  1  for  x  =  0. 

|sin(a^x) | 

8,  LEMMA.  If  |x|  s  n/2M  ,  then  -  a  2/n  for  every  a  ed. 

Proof.  lx|  s  n/2M  =»  for  every  e  d,  |x|  s  7r/2a^  =» 

|sin(a  x) | 

- 5 -  2  2/n.  m 

la  x| 

'  1  ' 


12  71  W  1x1  5M  y 

y  X 

J 


These  last  two  results  can  be  combined. 


9.  LEMMA.  For  every  x  e  R,  there  exists  y  e 

X 

every  a  e  d  -  {y  } 

1  X 


|sin(ax)j 
_ ^  ^ 

|a^x|  5M* 


such  that  for 
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Proof.  Since  M  >  1,  -  >  -  -i—  =  — - - -  .  With  this  we 

"  "  Siri^  5H* 

consider  separately  |x|  s  n/2M  and  |x|  >  n/2M  and  apply  the  preceding 
lemmas.  ■ 


We  can  now  conclude  the  theorem. 

Proof  of  the  theorem.  Let  a  =  (w  ,w . w  )  €  r".  It  is  readily 

12  n 


checked  that 


,(«)  =  [I 


sin(a^Wj/2) 


J=i 


a  u  /2 
»  J 


Let  w  €  R  be  fixed.  For  each  coordinate  w  of  w  let  y  be  an  element 

J  "j 

of  A  provided  by  Lemma  9.  Since  there  are  at  most  n  distinct  y  and 
since  there  are  n+1  distinct  elements  in  d,  there  exists  an  element 


a(u)  e  d  such  that  a((j)  *  y  ,  J=l,2,  ...,n.  To  complete  the  proof  let 

(j) 

J 


u  =  H  ,  hence, 
i 

n 


I  =  [  IA3  (CO)  I"  ^  lAa(„)(co)|^  =  P 


sin(a(w)Wj/2) |2 


1=0  1=0  1 

(apply  Lemma  9) 


J=i 


a(w)w^/2 


{h  1^.1} 


j  =  i  mEix 


3.4  Piecewise  polynomial  approximate  identities 
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3.4.. Piecewise  polynomial  approximate  identities 

Our  choice  for  (p  in  <P^*f  is  a  piecewise  polynomial,  for  (p  can  then 

have 

i.  compact  support, 
ii.  nonnegative  values  everywhere. 

Hi.  Ein  analytic  representation  in  digital  simulations, 

iv.  a  predetermined  number  of  continuous  derivatives, 

V.  a  tractable  Fourier  transform. 

Let  R  be  the  characteristic  function  of  the  unit  cube  in  R"  centered  at 


the  origin.  We  use  the  following  notation: 
g: r"  — >  R,  for  a  6  r”,  and  for  x  e  r”, 

g  (x)  =  —  g(|)  . 

s  n  S 

S 

g,  ,(x)  =  g(x-a)  . 

I  31  J 

Our  choice  for  <p  is  denoted  ip  ,  k  e  IN, 

<k> 


for  any  function 


<k> 


- k+1  times - 

(R  »  R  *  • • •  *  R) 

l/(k+l) 


It  has  the  following  readily  checked  properties: 

i.  The  support  of  is  the  centered  unit  cube  in  r"; 

the  support  of  is  the  centered  cube  of  side  length  s. 

h  I  =  1- 

"  <k>slll 

ii.  <p  (x)  i  0,  X  e  r". 

<k> 

Hi.  is  a  piecewise  polynomial  of  degree  k. 
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IV. 


V. 


<p  has  k-1  continuous  derivatives. 

’^<k> 


(p  (w)  = 
<k>s 


-  /•  ^T^***^ 


w  =  (w.  ,£«>„ . W  )  e  IR  , 

12  n 


^(u)  =  II 


sin(£jj/2) 


0)  /2 
J=i  J 


As  usual  we  have  for  the  first  error  term  e^,  for  f  e  L^(IR”), 


l5p<oo, 


e  =  X  (f  ~  <P  *^"1 
1  t  ^<k>s 


'p  s — X) 

and  for  p  =  co,  for  x  a  point  of  continuity  of  f, 


>  0  ,  lsp<(», 


fix)  -  U  •f](x) 

^  <k>s  •' 


8 - W 


->  0. 


For  any  f  of  interest  we  can  choose  a  suitable  s,  but  the  convergence 

in  not  uniform  (e.g.  ,  f  a  square  wave  on  D  c  R  ,  D  =  suppf^  *x  ]. 

with  unit  amplitude  and  period  L,  then  for  any  fixed  s,  p  *  co, 

approaches  L  approaches  0).  Consequently,  we  have  no 

more  to  say  about  any  upper  bound  for  c^. 

We  note,  however,  that  for  a  fixed  choice  of  k,  the  set 

{ffl  :  s>0}  is  a  one  parameter  subset  of  L*’(r”),  and  each  op  is  a 

<k>s  <k> 

piecewise  polynomial  with  compact  support.  These  properties  make  it 

practical  to  evaluate  by  simulation  the  appropriate  size  of  s  for  the 

vision  task  at  hand.  Such  a  choice  for  s  determines  e  which  in  turn 

1 


suggests  an  upper  bound  for  e^,  e^,  and 


For  e  +c  +e  defines  the 

2  3  4 


radius  of  a  neighborhood  about  *f.  The  approach  will  be  to  make 

this  radius  as  small  as  desired  for  a  fixed  s,  hence  for  a  fixed  e 

1 

A  conservative  guide  would  be  that  the  radius  should  be  small  compared 


to  e 


Beyond  these  remarks  any  additional  significance  for  the  size 


3.4  Piecewise  polynomial  approximate  identities 
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of  the  neighborhood  depends  on  additional  problem  structure  such  as 
that  discussed  in  the  Introduction.  Our  interest  hereafter  is  solely 
how  to  achieve  an  error  bound  radius  of  a  predetermined  size. 
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3.5  Interpolation  in 

With  the  choice  of  m  above  we  t\irn  to  the  error  e  .  We  shall 

<k>s  2 

use  frequently  the  facts  that  for  g  and  h  functions  on  R"  such  that  g»h 

is  defined,  for  s>0  and  for  a  €  R", 

ig*h)  =  g  »h  , 

8  8  8 

Ilg  II  =  11^:11  for  g  e  L^(r”),  and 
8  1  1 

ll£:*hll  s  llgll  llhll  for  i=—  +i-l,  lsp,g,  rsoo,  Os  i/oo 
p  qr  P  Q  ^ 


(Young’s  inequality), 


We  shall  also  need 


10.  LEMMA.  For  k  a  1,  for  y  =  (y  ,y . y  ),  and  for  1  s  p  s  », 

1  &  n 


<k>s-^[y3  <k>s'*p 

, n( 1--) 


with  the  convention  0  =  l/oo  . 


- k- 1  1 1 raes  — 

Proof,  Define  K  =  (R  »  R  *•--»  R) 
first  term  in  the  minimum  use 


s/(k+l) 


To  establish  the 


(<p  1  -  <p  II  =  IlK  •  R  • 

^^<k>S'' [y]  ^<k>s^'p  s/(k+l) 


ffR  ] 


[y] 


R 


s/(k+l)  1  lip 
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with  the  obvious  modification  if  k  =  1.  We  have,  with  0=l/oo, 

n 

I  K  II  =  1  and  ||  k  ,  ||  =  f— 1  ”  . 

«  "i  "  s/(k+l)  "p  L  ®  J 

whereas  I  fk  ,  ~  ^  .,11  is  times  the  Lebesgue 

s/(k+l)-'[y]  s/(k+l)n  L  ^  J 

measure  of 


r  r  s/2 

s/2t 

r  S/2 

s/2t  1 

[lyi-wi  > 

■“  ^  LVkTT  > 

VkTrlJ 

f  p_s/2 

s/2t 

r  S/2 

s/2-,'1 

[L  k+1  ’ 

L  k+1  ’ 

k+l-l  J 

where  for  sets  A  and  B,  A  A  B  =  (A  -  B)  u  (B  -  A) .  Let 

j  _  r_s/2  s/2n  -  _  r ,  s/2  s/2-\ 

-^1 


Then 


Scfui  x**'xl  x(I  -I)xl  x--'xl  1 
11=1  y  y  y  y  y 

^  •'i  ■'i-i  ■'i  ■'i+l 

(.5. 


U 


Ix*'’Xl(I-I  )xlx'’-xl 
>^1 


)■ 


so  that,  with  IISII  denoting  the  measure  of  S  , 

.  n-1 


^  2  I  '^,1  [eIt]' 

i=l 


Hence , 


C«.,  k+lO  I 


k+1 


R  —  2 

's/(k+i)-' ty]  s/(k+i)n  s 


1=1 


which  completes  the  proof  of  the  first  term  in  the  minimum. 

To  establish  the  second  and  third  terms  in  the  minimum  use 


(p  ] 


<k>s-'  [y] 


<P 

<k>s  ''p 


^  IIKII 


\R 


s/(k+l) "l 


^^s/(k+l)^ 


(yi 


R 


s/(k+l) 


For  the  case  p<oo  the  second  term  follows  from 
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~  R  ^ 

s/Ck+l)-^  [y]  s/(k+l)"p 


while  the  third  term  follows  from  IISII  s  2 


i/p 


For  the  case  p=oo  it 


suffices  for  both  the  second  zmd  third  terms  to  note  that  <p  is 

^<k>s 


nonnegative,  hence 


^•^<k>s^[y]  ^<k>slloo  ^  ll^<k>s 


The  following  lemma  indicates  that  we  have  many  choices  for  an 
interpolating  function. 


11. 

LEMMA.  Let 

g  e  L^(R”). 

g  ^  0, 

and  supp  g  c  B(0,r),  the  ball 

of 

radius  r  in  r". 

Let  T  > 

0,  N 

€  IN,  and  N  =  (BN+l)". 

Let 

V- 

.  .  ,  e  }  be  an 
n 

ortho normal 

basis 

for  r",  and  let 

denote 

the 

set 

of  points  in 

r" 

{ E  Pi",  ■ 

'-i=i 

P,  e  2, 

Ip,I=snJ  . 

Let 

R 

{T} 

II 

,  X  e  R  . 

Define 

!/'  =  £•  and  0^  = 

'^[X  ] 

-  n  times  - 

For  £  c  R”  such  that  supp[%^  *  c  [-Nt,  Nt]x.  .  .  x[-Nt,  Nt]  =  D  , 


II  £11, 


then 
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Proof.  From  the  definitions 

N 


J=1 


N 

=  %^(x)  J  gix-t)  ^  • 

B(x,r) 


It  suffices  to  check  that  for  x  e  £  then  B(x, r)  c  D,  and 

N 


j?! 


=  1  on  D  . 


[x  ] 
J 


Since  R  =  t^R  by  definition, 

{T}  T  '' 


12.  COROLLARY.  For  supp(%^  »  Zg(Q  ^  and  for  ijj  = 

-  I  times  -  N 

t”(K^  *•••*£),  then  V  =  1  on  £. 

j=i  ■’ 


With  this  we  can  now  establish  an  upper  bound  for  e^.  We  choose 

-  f,  1 1  mes  - 

il)  =  t"(R  »  •••  *  R  ).  Let  {x  }  and  \b  be  as  in  Lemma  11,  and  let  N 
r  T  i 

be  sufficiently  large  to  satisfy  the  condition  in  Lemma  11. 


13.  THEOREM.  Let  <p  =  ,  l£g,g'soo,  1/g  +  1/q'  =  1  (0=l/oo),  f 

N 

€  L'^Cr”),  and  let  h  =  £t.  For  c  =  II X  f<P*f  ~  Y  (^*f)(x  )  1 1I  , 

2  S'-  J  J-'  p 

l<p<oo,  then 
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Proof,  We  have 

M 


|y  (Jf)  f  f[<p(x-t)  -  ^)(x  -t)]  f(t)  dt  til  (x) 

j=i  ^  ^ 

^  I  i^[x-x  ]  ■ 


^  i^iq  [^]  min|  ^nh  .  [^nh]  ,  2'^“  |  X^U)  l^t/i^ix)  . 

where  the  last  inequality  follows  from  Lemma  10  and  from  suppi/i^  c 


{llx-x  II  sh/2>. 
J  “ 


We  conclude  this  section  with  some  remarks.  First,  we  have 

required  that  f  e  L^dP”)  because  only  for  q  =  w  does  depend  on  s  and 

h  according  to  h/s.  This  is  the  simplest  case  for  applications.  As  we 
shall  see,  we  will  obtain  ||3:^||  as  a  factor  in  the  bounds  for  and 

as  well. 

A  further  remark  is  that  for  h/s  sufficiently  small  the  minimum 
k+1 

has  the  value  of  - nh. 

s 

A  final  observation  is  that  the  smallest  boimd  is  obtained  for  the 
choice  of  [fi  =  R  ,  that  is,  £  =  1. 

^  {T}  ’ 
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3.6  Approximate  reconstruction 

In  this  section  we  shall  determine  zin  explicit  upper  bound  for  the 

third  error  e  .  We  use  the  notation  and  definitions  of  the 

3 

Construction  section  and  we  use  the  specific  convolutors  {/i  }"  of  the 

i  1=0 

Lower  Bound  section.  This  bound  requires  more  work  than  any  of  the 

others.  The  first  task  is  to  determine  the  values  of  k  in  ®  for 

<k>s 

which  h  =  (<p  is  in  L^(1R").  To  use  effectively  the  lower  bound 

1  ''^<k>sJ  1 

C(w)  we  shall  need  the  following  lemmas. 


14.  LEMMA.  For  a,  b,  p,  q,  and  x  all  nonnegative  real  numbers, 
for  p-q  a  0,  and  for  b  *  0, 


(mEO{{a,  x} 

( maxi  b,x})^ 


Proof.  It  suffices  to  show  that  the  left  side  of  the  inequality 
is  bounded  by  some  member  of  the  set  on  the  right  hand  side  for  each  of 
the  cases:  xsa,b  ;  a^x^b  ;  bsx^a  ;  a,bsx  .  m 

15.  LEMMA.  For'  a.  b,  p,  q,  2Uid  x  all  nonnegative  real  numbers, 
for  bia,  p-q  ^  0,  and  for  x  ^  0,  b  *  0, 

(max{a,x})^  ^  .  fimaxia,  x}  I**  p-q 

-  =  min  ■< -  ,  X 

(max{b,x})'*  ^  b^ 


j  5  minib^"'^  ,  x^  <iy 
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Proof.  For  the  first  inequality  it  suffices  to  show  that  the  left 
hand  side  is  bounded  by  each  term  in  the  set  on  the  right  hand  side  for 
each  of  the  cases:  xsa.b  ;  a^x^b  ;  b^x  .  For  the  second  inequality, 
since  bfca,  it  suffices  to  check  the  cases  X^b  and  xsb.  m 


We  can  now  prove 

16.  PROPOSITION.  For  (k-2)p  >  1,  then  ^ 

l:sp<oo.  In  particular,  k  =  3  is  sufficient  for  ft  e  L^(IR"). 

1 


Proof.  It  is  straighforward  that  for  w  =  («  ,0) . w  )  6  R"  then 

12  n 


r  sin 


K.j'''"'  ‘  n 


j=i 


f  “iL  1 
[2(k+l)J 


(j)  s 
J 

2(k+l) 


k-i-l 


Since  |sin(x)  smin{|x|,l}. 


"i-li  .  2^^  ’ 


=  E 


,k+l 


II  Lk+1  ,  ,r 

j.i  "“f— .  lu  i| 

From  the  definitions,  n,  =  .  With  this  and  the  theorem  from  the 

Lower  Bound  section. 


[ft  (w)  I  =  r<p  ^ 

'  1  '‘^<k>s''  n 


A.  (w) 


t=0 
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max|^  ,  IWjlj 


{4-  '  1‘^jl}  .  I^^jl} 


j=i  max 


Note  that  a  may  be  replaced  by  m  =  min  {a  }  .  With  this  and  Lemma  14, 

‘  a  e^4  ‘ 

1 


,  n(k+l) 


k+1 

Note  that  2-^  may  be  replaced  by  K  =  max-| 


•  [5[h]  J  }■ 


Lemma  15 


“  m  (D 


,4->2n/-^-xn  n(k+l) 

K 


n  r  meix 

P  rain 
j=i 


|[h]*.  i“/} 


2-k 


^.1 


JWj  I 


iC+1  A 

(The  case  2-^  =  K  is  typically  the  case  of  interest  here. )  Hence, 
e  L^(IR”)  ,  l:Sp<oo,  whenever  (k-2)p  >1.  ■ 


The  next  result  is  a  well  known  tool.  Our  notation  for  some 
steindard  items  is:  5(7  for  the  boundary  of  the  set  U-,  i  for  the 
imaginary  element  in  C;  wx  for  the  usual  scalar  product  of  w  and  x  in 
r";  d«  for  the  standard  volume  form  for  r"  represented  by 
dwAdwA--*Adw  in  the  coordinates  (w  ,w  ,...,w  ),  where  a  is  the  wedge 

1  2  n  1  2  n 

product  of  differential  forms;  and  ...Adw^A...  for  the  deletion  of  the 
factor  dWj  in  a  wedge  product. 
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17.  LEMMA.  Let  R"  — >  \R  ,  g  e  C^(R")  (i.e.,  g  has  k  continuous 

dg 

derivatives).  Let  d ^g  denote  the  partial  derivative  ^  .  Let  t/  be  an 
open  set  in  r"  with  compact  closure  U.  Let  U  have  a  triangulation 


consisting  of  different ialble  singular  n-simplexes  in  R  .  Then 

iwx 

'1  "2  "k 


fca  8  •  •  -  a  g)e 

^  *^1  *^2  K 

u 

.  r  1  r  aU 

^  ^  j  /  \  ^ 

+  (-1)  (a  •••a  g)e  duA’*-Adw  A'*-Adu 
J  Jo  J,.  1  J.  " 


U 

k-l 


s=2 


g)  e^  ^  do)  A  •  •  •  Adw  A  •  •  •  Adu 


au 


f  *‘-1  -N  J  r 

I  J]  (-LXj  )  (-1)  *'  \  g  e^  ^  du^A**'Adu,  A-'*Adw 

'■  dU 


J, 


[  n  )]  \  g  e^’^  do> 

^  r  a  1  r  •' 

u 


Proof.  Stokes  theorem  and  induction  on  k. 


18.  COROLLARY.  Let  d  a  •  • -a  g  =  0  on  dU  for  0  s  s  s  k-2  and 

■'i  ^2  s 

for  any  indices  j  ,  j . j  .  Then,  for  llxll  any  norm  of  x  e  r", 

12  s 

J  g  e^  ^  du)  =  0 [llxll  as  llxll  - > 

U 


00  . 
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Proof.  From  the  lemma 
J*(9^  g)e^  ^  dti) 


U 


'1  "2 


J  +1 


-  (-1)  ^  [(a  ••■a  g)e^'^  do) 

J  Jr,  Ji.  ^ 


au 


A  •  •  •  AdU  A  •  •  •  AdW 


=  (  ']  I 

r  1  ^  U 


<W'X  , 

e  du  . 


Consequently,  by  letting  =1,2 . n  and  taking  the  sum, 

f  E  •’•3  g)e^  ^  did  -  fca  a  •••a  g)e^  ^  (xjdw) 

J  4._r  ^  Jr,  J,.  J  Jr,  Jr,  J,. 


U 


t  =  l 


au 


2  3 


where  xldw  =  )  x  du  a*  •  -Adu  a  -  •  -Adu  . 

J  L  J  1  J  n 

j=i 

Repeat  this  for  the  remaining  indices  J^,  normalize  by 

n  X 

dividing  by  lx|  ,  |x|  the  Euclidean  norm  of  x.  Let  a  ,  .  =  V  -j — f  8  . 

X/  1  X  I  Li  I  X  I  j 


J=1 


Thus 


k-l 


U 


au 


r  .,k,  ikf  iU’X  , 

=  (-l)  |x|  g  e  du  . 


(7 


We 


now  begin  the  comparison  of  approximation 


J]G(x  )i/»  .  We  consider  first  Some  required  notation 

J  ■'  •’ 

n 

follows.  Let  f  =  supp  <p  ,  .iM  D  U  supp  u  ,  let  Xu>  and  deonote  the 

<k>s  1  r  M 

1  =0 
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characteristic  functions  of  if  and  M  respectively,  and  define 

if  +  M  =  supp  •  Xj^  , 

-  p  t 1 mes  - 

if  +  pM  =  supp  X^  *  ‘  *  "X-J^  • 

We  have  -if  =  if  and  we  shall  require  -M.  =  M.  As  usual,  we  abbreviate 
w  by  <p.  Recall  that  we  have  the  relation 

^<k>s  ^ 

n 

J]  Mj*  f  =  (p*f  . 

1=0  ^ 


19.  LEMMA. 

1(0) 

t  1=0  J 


+ 

• 

n  / 

• 

1  =0 

Proof. 

=  Eh,,  [[m,* 

1=0  1=0 

1=0  •'1=0 
The  first  term  in  this  sum  evaluated  at  0  is 

( » •  (0)  =  (p»fiO)  . 

The  second  term  evaluated  at  0,  after  adding  and  subtracting 


1  =0  ' 
s 

.  V.  J  J 
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is 


Jo"'* 


and  the  first  term  in  this  sum  is 


l\*  (m,»  (0)  =  [«)  »  [fXy^2M^l-Xy))yO)  =  0  . 


Now  we  decompose  this  expression  for 

[»)*/]  (0)  =  f  I  [ft 

^  i=0 


'■1=0 


This  same  proceedure  can  be  carried  out  at  x^. 


(0). 
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20.  COROLLARY. 

■ 

■  J  ^  ^  J  ^ 

*  ■ 

*J 

Proof.  Apply  [a»b](Xj)  =  [a*b^_^j](0)  ,  e.g. 

[v»f)(Xj)  =  j](0)  and 

Ca*(^t.,^jb)}(0)  =  )  . 

The  convolutions  above  can  be  replaced  by  the  scalar  product. 
Define  for  a,  b:IR"  — >  IR,  <a,b>  =  /  ab  .  Whenever  b(t)  =  b(-t),  then 

fa*b](x  J  =  <a,  b  >  =  <a  ,,b>.  Therefore, 

'■  •'  J  [x  ]  [-X  ] 


21.  COROLLARY. 


I  =0 


+ 
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Let  7)  (x  )  and  7)  (x  )  be  the  second  and  third  terms  respectively 
1  j  2  j 

of  the  right  hand  side  above.  Then 


e  = 
3 


\  I  -  E  Z<CC^>:x3''),.  ,  •  CW,x 

*■  jej  jej  1=0  J  J  ■' 


^  \\x^  E 


jej 


jej 


J"p 


s  max-< 


We  turn  to  determining  bounds  for  7)  (x  )  and  7)  (x  ).  We  address 

1  J  6  J 

7)  (x  )  first,  this  case  being  easier. 

2  J 

First,  7?  (x  )  is  the  sum  of  two  terms,  each  of  the  form 
2  J 

”  V 

J]  <  ^  '  which  is  bounded  by 

i  =0  J 

I  i^sK*C^[-x  l^T)3i2 

1=0  j 

s  I  {2n)~^^  11^1 

1=0 

-  E  ii'*i  111  11*  "2 

1=0 

It  is  easy  to  see  that  this  also  bounds  t?  (x  ).  Recall  that 

2  J 


1  "1 


1. 


We  use  the  proof  of  Proposition  16  to  bound  ||  }  ||p  >  P>1- 

,ic+l  ^ 


If  ssM  and  k^3  then  2- 


1/3 


,  and  this  is  the  case  we  shall 


assume.  Let 
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a  = 


4  1/3 


b  =  2 


k+1 


so  that  by  the  proof  of  Proposition  16,  with  C  a  constemt. 


n  max 

|fj^(«)|  sc  II  - 


I  .  |«  1^  J 


■  '“/I 


J=1 


By  definition,  1-%^  is  the  characteristic  function  of  the  set  {llwll  >X} , 

A  00 

where  Hull  =  maxi  I u  I  ,  j=l,2,...n>.  Note  that  the  zero  set  of 

00  J 

[v  contains  {Hull  =  In  2^^^^,  telN> .  Consequently,  because  of 


k+1 


Lemma  17  and  its  corollany,  we  shall  later  choose  \  =  tn  2—^  =  inh, 

and  this  is  convenient  here  also.  Finally  observe  that 

n 

{Hull  >X>  =  Uillull  >X}  n  {|u  |=Hull  >  . 

00  00  i  00 

1=1 

We  outline  the  integration. 

C"‘’||ftj(l-;K;^)  I'*  s  y  I  17  mini  •  •  •}'*  s  n  |  []  mini  •  •  • } 

1=1  ''j  =  i  '^j  =  i 

{Hull  >A,}ni|u  |=HuH  >  {Hull  >X}ni|u  |=lluH  } 

00  1  00  00  n  oo 


=  n2‘  I  y' 
\ 


"  I  I  [4]  -  *  j  f4]  -  ^ 


dx 


n-l 


(use  asb  and  the  inequality  |v"  -  (v  +  u)"|  s  n |u |  [| v  |  +  | u | ) 


,  l  +  p(2-k)-^n-l  ^  1 +p  (  2-lc) 


p(k-2)-l 


With  this  and  with  p  =  2, 
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max{  |t7_(x  )  |} 
J  ^ 


|l+2(2-k)^n-l  j^^^l+2(2-k)  2 


;k-2)  -  1 


2(k-2)-l 


We  now  turn  to  Whereas  we  used  X  to  control  the  size  of 

7)  (x  ),  we  shall  depend  on  M  to  control  the  size  of 
2  J 

,_(x)  =  <  cft.zj''  ,  [m,*  =■■ 

How  this  is  done  is  indicated  in  Lemma  22  below.  First  some  notation. 

As  previously  noted,  we  use  %■.  to  denote  the  characteristic  function  of 

k+1 

{llwll  £A>  and  we  choose  X  =  tn2 - ,  where  I  is  some  positive  integer. 

00  S 

For  simplicity,  let  A  =  {llwll  .  Then 

00 

n 

A  =  n  {  I  w  I  s  A}  , 

1=1  ^ 
n 

aA  c  U  {  Iw  I  =  A}  . 

1  =1  ^ 

A  second  item  of  notation  is  the  multi-index  a  =  (a, a . a)  € 

12  n 

n  a  a  a 

in".  Define  |a|  =  Va  ,  a!  =  a!a!*-*a!  ,  and  3**  =  3  ^3  •  a  "  . 

J  12n  12n 

J=1 


22,  LEMMA.  If  lal  -  k,  then  =  0  for  w  e  aA. 

Consequently,  for  all  r^k+l,  x  €  r",  with  |x|  the  Euclidean  norm  of  x, 


I  i  — - - — 

‘  (2Tt)"  Ixl" 


la  " I  .ft  I  .  . 

"  x/ 1 X I  i  n ,  A 
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Proof.  The  first  statement  follows  from  the  property  v  of  <p 

<k>s 

In  Section  4,  from  the  product  formulas  for  derivatives,  and  from  the 
definition  of  The  second  statement  follow  from  the  proof  of 

Corollary  18.  ■ 


Several  lemmas  will  be  required  to  bound  ||S  ||  .  .  Since 

"  x/\x\  i"i,A 

fti(w)  =  it  suffices  to  bound 

sipply  Leibnitz’s  rule,  and  finally  to  integrate. 
Recall  Leibnitz’s  rule  for  C  valued  functions  f  and  g  on  R",  with  a,  /3, 
7  multi-indices: 


=  I  0^f)(5^g)  . 

P,7 

0+y=a 

(In  the  particular  cases  exajoined  here  all  Fourier  transforms  have 
values  only  on  the  real  axis. ) 

It  will  be  convenient  to  have  a  bound  for  which 

depends  only  on  |a|. 


23.  LEMMA.  s 

f  s  ]'“'(ic+|a|)!  J“'  "  r  ,  1 

[2(k+l)J  k!  2  j]  min|  1  ,  -  — 

^  J=i  *■  Iw.U 


j'2(k+l) 


j^k+l 


(min{l,l/x}  is  understood  to  be  1  for  x  =  0.  ) 


Proof.  Let  <p'  denote  <p  constructed  for  R. 

<k>s  <k>s 

definitions,  for  w  =  (o  ,u . w)  e  r", 

12  n 


From  the 
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f(jp  =  n  fjp' 

'■  <k>sJ  "  *■  <k>s-'  J 

J=1 


Claim.  For  u  e  IR  and  for  r  e 


Proof  of  Claim.  The  first  element  in  the  minimized  set  is 
established  by 


a-fi 

'l(u)  1 

L 

^  <k>s-' 

J  ' 

(t)  1  ItTdt  £  I 


[--  -1 
2’2 


<k>s 


<k>s "1 


The  second  element  is  established  by  induction  on  k.  Recall 

k+l 


By  Leibnitz’s  rule 


sinc(u)  =  sin(u)/u  . 


[fv?' 

'l(u)  1  s  E 

1  1  ^ 

^  e=0 

W 1 

L^J 

e!  2  ^  , 

-Sr! 


\v\ 


e+l  S 


hence  the  result  for  k  =  0.  Recall  the  notation  g  (v)  =  g{v/s)  for 

ts) 

s>0.  Consequently  [d^g  )(u)  =  ( l/s)*^(3'^g)  (u/s) .  With  this  notation 

\S> 

k 

From  Leibnitz’s  rule,  from  the  result  for  k=0,  and  from  the  induction 
hypothesis 


^  (sY  1  r,  .  2(k+l)l''  f2(k+l)l‘'*^  ^  frl(e+k-l)!  , 

"  W  ^4'  ’  ['wj  iJeJ-nFTTT-''- 


e)  I  , 


and  the  final  sum  is  checked  by  induction  to  be 


(k+r)l 

k! 


This  proves 


the  claim. 
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f k+r) • 

Observe  that  -  a  1  and  that  for  y>0 

k!  (k+l)'" 

min{l  ,  (l+y)V''*^^  ^  min{l  ,  2'^y’'*^}  s  2''min{l  , 
With  these  observations 

r  s  Y  (k+r)! 

[2(k+l)J 


k! 


n  . 

nminJl. - L_ -  . 

J=1  ^  ^  ^ 


'^*2(k+l) 

Since  (‘<’5  =  TT  ^  ^  [^•^<it>s^^]  ^  remains  only  to 

check  by  induction  on  n  that  for  a  multi-index  a 


n  ( k+a  ) !  k+ 1  a  I ) ! 

n-kr^  = - 

j=l 


k! 


— 

r  »  . 

We  next  bound 

derivatives 

of  D  = 
i 

A 

■ 

=0  ■' 

From 

Leibnitz’s  rule  and 

A 

since  u  = 

A 

o 

V 

Of 

> 

it 

suffices  to 

consider 

1 

derivatives  of  the  second  factor.  A  formula  for  higher  derivatives  of 
compositions  of  functions  will  be  needed.  Let  s(e)  denote  a 

multi-index  with  e  coordinates  s(e)  =  (s  ,s  ,...,s  ).  For  a  function  f 

12  o 

(Si) 

of  one  variable  let  f  denote  the  derivative  of  order  s  . 

1 
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24.  LEMMA.  For  g,f  €  £f(IR),  with  r  a  1, 


ifog) 


"’'Z  I 


e=l  ls(e)|=r 


fs  +•  •  *+3  -1 

3  +• • • +3  -1 

s  -1 

1 

2  e 

e 

CO 

s  -1 

s  -1 

L  1  J 

2 

W  • 

e 

s 

1 


f.(e)  U 
X  \f  og\  Ig  g 


(s. )  (s  )  (s  ) 

2  e 

.  .  .g 


Proof.  The  proof  is  by  induction  on  r.  With  the  convention  0!=1 
the  case  r=l  is  clear.  Assume  the  result  for  r-1. 

(apply  Leibnitz’s  rule  and  the  induction  hypothesis) 


'  ZC-:]  z  z 


S=1 


fs  +•  •  *+3  -ll 
1  e 

S  -1 
1 


s  +• • • +s  -1 

2  e 

S  -1 
2 


s  -1 
e 

s  -1 


e=l  |s(e)|=r-s 
s 

1 

X  [f  “’gj  l^g  g  -"g  ^  g  j  +  [F  °g]-g  ^  ■ 


Observe 
r-1 


z  f:]  z  z 

s=l  e=l  ls(e) 


r 


e=l  ls(e)|=r-s 

s  al 
1 


r- 1  r-e 


=  z  z  z  f:] 

e=l  s=l  |s(e)|=r-s 


s  si 
1 


r-1 


=  z  z  f:) 

e=l  s  +s  +s  +---+S  =r 

0  12  e 


s  ,  s  si 
0  1 


The  term  [f  ^  ^  ^  og]  •  g^^^  corresponds  to  an  additional  e=0  term  in  the 


last  formulation  of  the  summation.  By  renaming  these  r  values  for  the 
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index  e  (add  1)  the  desired  form  is  obtained.  ■ 


Some  miscellaneous  results  that  will  be  needed  are  collected  in 


25.  LEMMA.  Let  8^  be  the  directional  derivative  in  direction  v  e 

r”. 


1.  Lemma  24  holds  for  f  e  C(R),  g  6  C(r")  if  5*^  is  replaced  by 


a". 

V 


a. 


I  I 

e=l  |s(e)|=r 

s  2:1 
1 


s  +•  •  *+3  -l" 

S  +•  •  *+3  -l' 

8  -1 

1  e 

2  e 

« 

s  -1 

s  -1 

s  -1 

1 

V.  J 

2 

e 

■I  I 

e=l  |s(e)|=r 
s 

i 


r  -  1' 

fr-l-s  1 

V-l-S  • '-s 

1 

1  0-1 

s  -  1 
'•  1  J 

s  -1 

s  - 1 

2 

V  J 

e 

C  J 

ILL.  For  <p  €  C^Cr")  and  for  r=|a|sk,  if  M(|a|)  is  a  bound  for  a% 
which  depends  only  on  (a|,  then,  for  |v|  the  Euclidean  norm  of  v, 


Proof.  For  i,  if  f  e  C(r"),  x,  v  e  r",  and  if  Py:IR  — >  R"  ,  Py(t) 
=  X  +  vt,  then  [a^f](x)  =  [a''(f op^)]  (0) . 

For  LI,  The  first  relation  uses  s^+s^+"'-+s  =  r.  The  inequality 


follows  from 
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^  ^  r  (r-D!  (r-s^-1)!  (r-s^-s^-1)! 

2_  r  (s  -1) ! (r-s  ) !  (s  -1! (r-s^ -s_) !  (s_-l ) !  (r-s^ -s_-s_) ! 

e=l  |s(e)|=r  ^  12 


12  3 


12  3 


s  si 
i 


(r-s  -s  • --s  -1) ! 

12  e-1 

^  (s  -1)!0! 

e 


=  I  I 

e=l  ls(e)| 


r! 


fr(r-s  )(r-s  -s  )**'(r-s  -••■-s  )') 

=r  '-112  1  e-1  •' 


s  si 
1 


[(s^-1)!  (s^-D!  •  •  •  (s^-1)!] 


=  y  y  .  - d - 

1  I  r  1  I  frCs  -1)!] [(r-s  )(s  -l)!l • • •  f(r-s  • --s  )(s-l)!] 

e=l  |s(e)|=r  ^i-'^i2-''-i  e-ie-^ 


s  si 
1 


t  I  “  I 

AO  A  4—^ 


r! 

a! 


,  with  this  last  summation 


e=l ls(e) |=r 

s  si 
1 


|a|=r 


in  multi-index  notation  (a  e  (N  )  ,  while  for  m  e  IN,  s  e  R, 

i 


i=l,2, . .  .  ,  r. 


For  ILL,  use 


M=i  |al=m 


a  a  a 

12  r 

S  S  •  •  ’S 

12  r 


y;  ivj  i  Vn\v\  ,  d^<p  =  E  v^a^(p  , 


1  =1 


i  =1 
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hence 


3 ''4 

V 


=  I  Z  \  *  *  *  ^  \  ^  E  '  •  ‘  E  kt  ”  I 

t  =1  1  r 

r 

s  (v^|v|)*'M(r). 


t  =1  1  1  t  =1  r  r 

1  r 


t  =1 
1 


Now  we  can  complete  the  bound  for  |S^D^  (w)  | . 


26.  LEMMA.  For  v  e  IR  ,  |v|=l,  for  r£l,  and  for  w  = 

(w  . u . £J  )  €  r", 

12  n 


|a^D((<))|  s  (;Mi/n(n+l)r}''(r+l)!  ^ 


n(2r+l) 


2r+l 


n  r f  ^  r+1  i  r  ' 

^nniax|[JJ  [IJ  .It..! 


2r+3l 

j’  y 


Proof,  From  Leibnitz’s  rule  and  from  Lemma  24  with  /"(t)  =  t 


-1 


n 


and 


I A  2 

s  =  E  . 


1  =0 
r 

I 

p=0 


r  P 

's  +•  •  -+3  -1' 

r  ^ 

8  -1 

[p]^v-’^,I  I 

1  e 

s  -1 

4 

e 

s  -1 

e=l  |s(e)|=p 

1 

V.  J 

0 

(-1)  e! 


s 

1 


[i  10,1^1 

M  =  0 


e+1 


e  n  q 

‘HIE 

q=l  J=0  t  =0 
q 


s  -t 

a  ‘’A 

V 


a^'^A  |. 

V  ' 


From  Lemma  23  with  u  =  <p 

*^1  ’’^<0>a 


m  =  minia^},  M  =  mao{{a^},  and  from 


Lemma  25, 
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la;D(a.)|  ^  ^  y(VnM)'-P(r-p)!^nmin|l  .  } 


F 

I 


e=l  |s(e)|=p 


■V“^VM  |VM  (-1)%! 


%-M  f" 


[n  •\ « 

E  lAj" 

\  =n 


f|  ^  ^  (VHhI  nminjl  .  . 

=1  J=0  t  =0^ 


For  the  last  factor, 


e  n  q 


q=l  J=0  t  =0 
q 


s  ji  in*!) is  +1)1  iVnM)  n  >  -h;;^  } 

q  =  l  ^  j  =  l  ^  J 


(using  (a  +1)!  s  (Ia|+1)!  as  in  the  proof  of  Lemma  23  ) 
j  =  i  ■’ 


i  (n+l)®(A/nW)^  n  min|l  ,  |--|  (p+D! 


Combining, 


n  "“>{*  •  -nrii}  r 

|a^D^(w)|  ^  r!  (VnW)'^ - ^  (p+1) 

I  p=0 


I  E 

^  I  /•  N  I  •*■ 


e=l  |s(e)|=p 


s  +• • -+3  -1 


"  •  fi  2 

r  ,  ,  ,  n  min-(  1,  -j - 

,  (n-DjU.  I  l“j 


i  =0 
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2 

Since  |Aj(u)|^=s  ijminil  .  -n;^}  , 
j=i  1.  '  j'  J 

r 

|aJ^D^(w)|  s  riiVnMf  ^  (p+1) !p‘’(n+l)' 


n  min/l  , 


2p+l 


1=0 


P+1 


2r+l 


S  ( (r+1) !  )^(WiW)''(n+l)'' 


j;‘4  •  17^} 


A  /  .  %  I  2 


1=0 


r  +  1 


To  complete  the  proof  apply  the  lower  bound  theorem,  then  apply 
Lemma  1 .  ■ 


At  last  we  bound  d^fi  (u) 

V  1 


27.  LEMMA.  For  v  €  r”,  1v|=1,  r  a  1,  and  for  w=  (u,a>,...,w) 

12  n 


s  Air. k,n,4)  [^2^1  ^  * 


2r+3 


"  LA+1  ,  , 

TT  niax|2—  ,  I  Wj  I  j- 


where  C  =  max 

e=0, 1, . . . ,r 


r  ■\4(©+l)  (■  'v2e+l 

H 


l/(2e+3) 


,  and  where 


A(r,k,n,  j4)  =  ((r+1)!  )' 


k+r 

r 


,4-v  2n  n 


mil 


(k+llC 


2n 


+  VnM(n+l)r 


f5M^  : 

,.2n' 

[  8  i 

"J 
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with  d  the  set  {a  ,  a . a  )  of  which  M  and  m  are  the  max  and  min, 

0  1  n 

respectively. 


Proof.  Apply  Leibnitz’s  rule.  Lemma  26,  Eind  Lemma  23,  then  use 
the  inequalities 


r  f  4(e+l)  /• 


2e+l  2e+3' 


,  lo  I  Is  max 


V  / 


_2e+3 

C  max 


C  ,  IWjl  J- 

I  1  .IWjl/cJ 


•V  2r+3 


,  for  esr. 


and 


s  (e.l).(e+l)  ^  ( (r*l ) !  , 

and  finally  apply  the  binomial  formula. 


We  return  to  our  original  goal,  the  bound  for  |Tf)^(Xj)|.  Lemma  22 
and  Lemma  27  narrow  the  choices  for  r  and  k.  By  Holder’s  inequality 
and  by  Young’s  inequality,  along  with  ||hJ|^  =  1. 

^  2  iC^^x]''Cl-^;H3i2l^i2  • 

1=0 

We  may  assume  that  .4<  is  a  centered  cube  in  r”  with  side  length  B.  Let 
Bj(r,k,  n,  X)  bound  a  in  x  e  r”-{0>.  Then  by 


Lemma  22, 


B  (r,lc,n,X) 
(2jr)" 


j"  J  |xr^''dx 

R"-il 


Consequently,  we  choose  2r  £  n+1.  Since  llxll  s  |x|,  we  integrate  over 

00 

{llxll^>B>  in  the  manner  as  that  outlined  in  the  discussion  preceding 


174 


3.6  Approximate  reconstruction 


Lemma  22: 


B  (r,k,n,X)  Vn 

s  - 2"  i  ^ 


V2F^ 


From  Lemma  27  B^(r,k,n, X)  cam  be  determined. 


28.  LEMMA.  For*  V,  r,  oi,  d,  C,  and  A  as  in  Lemma  27,  for 
k+1 

k-2r-25tl.  for  X  =  ln2—  .  £  e  IN  -{0}  ,  A  =  {llwll  sX> . 

S  00 


111  A  ==  A(r,k,n,d)  2"  K^nCr^a) 


where 


N  =  2r+2-k,  u  = 


0  if  XsK 


1  if  X>K 


,  =  max 


■ 


Proof.  Note  that  each  occurrence  of  2—^  in  the  first  inequality 
of  Lemma  27  may  be  replaced  by  K^.  Thus,  by  Lemmas  14  and  15  combined, 
|a|^ft^(w)|  i  A(r,  k,  n,  max{K^,  I  w  |),2''+3ki 

Integrate,  treating  separately  Hull  sK  Eind  Hull  >K  .  For  example,  for 

00  1  00  1 
n 

XaK  and  using  r"  =  U  { |u  l=llwll  } 

1  1  00 
1=1 


•  K 

l®v^li,A  “  =  A(r,k.n,4)K,"“‘*”  n2''  J  K^”W 

0 

*  "2”  J  y"  n  [  J  *  J  y,Vj  J-iy 

It  ^  n  r 


,  X  ,  1  rr  N+(X/K  )”*\n  ,1 

^  A  t  I  /I'tv  o"  V  n(N+l)  1  Iff  1  ]  ,  | 

=  A(r,k,n..l)K  n2  K  -  .  - J  -  ij  . 

»  « 
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Note  that,  regardless  of  the  sign  of  N, 


N+(A/K^)""‘\  ,  N+(£7r  ) 

N+1  “  inT" 


N+l 

-]■ 


From  Lemma  27  B^(r,k,n, A)  can  be  chosen  to  be  independent  of  A. 
For  if  k+1  >  2r+3+l  the  is  in  L^dR").  Explicitly, 


29.  COROLLARY.  For  k  >  2r  +  3  ,  (i.e.,  N  <  -1) 


II  *  ^ 

''  V  1 1'  1 ,  A 


ffi\\  s  A(r,k,n,j4)K  ^"^''*^’2 

V  I II 1  1 


n  r  (-N)  1'' 
[(-N)-lJ  • 


In  Lemma  22  it  was  seen  that  r  could  be  as  large  as  k+1.  However, 

r  must  be  less  than  half  of  this  value  fo-r  the  Corollary  to  apply.  For 

exEunple,  the  Corollary  does  not  apply  for  ks5.  For  k=9,  r  can  be  no 

“13/2 

greater  than  2.  In  this  case  tj  (x  )  decreases  as  A  whereas  7)  (x  ) 

2  j  1  j 

decreases  as  0  ^  for  n  =  2.  To  have  tj^Cx^)  converge  more  rapidly  we 
must  choose  between  large  values  for  k,  and  hence  for  K^,  and  a  bound 
for  7}^(x^)  which  depends  on  A. 

We  can  finally  state  our  bound  for  |7)^(Xj)|.  We  conclude  this 

section  by  collecting  the  results  in 

30.  THEOREM.  For  E  a  compact  subset  of  r",  for  <p  =  <p  as 

<k>s 

1  2  n 

defined  above,  for  f  €  L  nL  (R  ),  for  h^,  Xy  '^</>+M’ 
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as  defined  above,  and  for  k  a  3, 


e  = 

3 


=  K  ♦  b,:  E  V^jl^lp 

J6J  J  J  »*  jgj  J  J  P 

i^{|T,^(Xj)|}||zJ|p  +  m^||T,^(Xj)|j.|z^||p  . 


s  max-< 


Let  C  =  max 

e=0, 1, . . . ,r 


A(r,k,n,d)  =  ((r+1)!  )‘ 


• 

fTT- 

4(®+l)  /•  +120+1 
lOTl 

l/(2e+3)‘ 

« 

[m\ 

bi 

. 

m 

• 

k+r 

r 


,4*v  2n  /v%*v  n 


ml] 


(k+l)C 


,2n 


i  ,  and  let 


+  vWf(n+l)r 


fsw 

I  8 


,4  2^2n| 
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with  4  the  set  {a^,  a^,  . .  . ,  a^)  of  which  M  and  m  are  the  max  and  min, 


respectively.  Let  =  max 


. 


k+1 

k  =  £n2—  ,  £  e  in  -{0}.  For 
s 


2r  a  n+1  and  for  k-2r-2?tl, 

1  Vn 
^  (271)”  VZr-ri 


2r-n 


max{  [t)^(x  )  |}  s  (n+1)  |f  ||, 
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0  if  ksK 


1  if  k>K 


and  where 


N  =  2r+2-k,  u  = 
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7  t  4  1/3 


Secondly,  for  the  case 


maoc{  |t}  (x  )  |> 
J  ^  ^ 
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3.7  Discrete  approximate  reconstruction 

We  have  in  this  section  the  payoff  for  all  of  the  preceding 

analysis:  We  can  exhibit  maps  defined  on  discrete  spaces  which  may  be 

used  in  a  digital  implementation  of  the  approximate  reconstruction. 

For  these  maps  we  develop  the  final  error  term  e^. 

To  begin,  recall  the  interpolating  function  0  used  in  the 

Construction  section  and  in  the  Interpolation  section:  — >  IR  along 

with  a  discrete  set  of  points  ^  in  R"  with  index  set  J,  <?» 

such  that,  with  t/i  =  t/j  ,  X  =  X  Ya^  •  where  £  is  a  subset  of  r" 
J  *=jej  J 

with  compact  closure.  To  condense  the  notation  of  the  previous 

section,  let 

(recall  is  symmetric)  and  let  the  set  !f+M.  be  denoted  by  S.  As  in 

the  construction  section,  let 

G  =  [  (H  . 

1=0 

In  the  preceding  sections  we  have  developed  the  manner  in  which 

J]  G(x  )\jt  is  an  approximate  reconstruction  of  f.  The  set  ^  may  be 
jej 

viewed  as  the  "reconstruction  set"  in  R". 

A  second  discrete  subset  of  R”  is  the  "data  set"  Q,  the  set  on 

which  the  convolutions  p^*f  ,  l=0,l,...,n,  are  evaluated.  As  in  the 

Construction  section  let  Q  be  the  index  set  for  Q,  Q  =  {x  }  .  We 

q  qeg 


shall  require 
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Q  D  ^ 

and 

for  every  x  e  Q,  x  e  q  e  Q,  J  e  J  :  x  =  x  q  =  J  . 
q  J  q  J 

With  this  notation  the  objective  of  this  section  is  to  exhibit  a 

map 

H^:Q  n  2  — >  R 

such  that  the  discrete  convolution 


G:^  - >  R 


Gix  )  =  [  E  (H  x^ix-x  )  ) 

l=OqeQ  ^  ^ 

approximates  G  in  the  sense  that 

"  jej^  J  ^  ^  IQI-^  0 

where  |Q|  is  a  suitable  measure  of  the  “mesh"  of  Q.  Here  the  irregular 
notation  is  used  in  place  of  Also  G  depends  on  Q,  but 

this  dependence  is  supressed  in  the  notation.  We  have  immediately 


-  S  [«,XsO(VX^) 


E  ”  p  , 


We  require  that  the  set  Q  have  associated  with  it  a  set  S  c  R  . 
With  the  notation  (x)  =  %„(x-x  )  for  q  e  Q,  x  e  Q,  x  e  r'',  and  for 

o  b  q  q 

q 

X^  the  characteristic  function  of  S,  the  sets  Q  and  S  are  to  satisfy 

I-  *  X^  ~  \  almost  everywhere,  and 

qSQ  q 


XcB  =  I  (XcK  ,  almost  everywhere 

S  ^  _  b  [x  ] 

X  eSnQ  q 

q 
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IL.  for  X  e  3,  for  x  ,x  ,  e  Q, 
J  q  q 


C^S  =  • 


q  q 


l^sii  \ 


'■  0  otherwise 


ILL.  ® 

With  these  conditions  on  S  and  Q  the  difference  in  the  expression  for 


splits: 


[  -  me  >:s  ,] 

'•q€0'-  bl  "^q 


(•) 


,  ( ?  iizX  <V '%,]”( 2  <^>]%  ] 

l^'-q'eQ  '^S  1  ^  q'-*  '-qeo'-  q-* 


(.X  ) 

q 


To  define  H  and  to  bound  e  we  specify  certain  remaining  choices. 

i  4 

In  particular,  let  the  index  set  Q  be  a  finite  subset  of  Z"  ajid  let  i 


be  a  second  finite  subset  of  1  .  Choose  6  >  0  and  A  >0  Euid  let 


n  t i mes 


Q  =  |x^=q5 

.  qe(?|  , 

S.  [-|,|]  X  ...  X 

r--  -1 

L  2’2i 

-  n  times 

^  =  |u^=tA 

,  teO|  , 

^  =  c-|4]  ><•••>< 

r--  -1 

L  2'2i 

where  A  and  $  are  chosen  such  that,  with  x  («-tA)  =  x  (w),  w  €  R”, 

§  ^ 
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We  now  define 


irjx  x^]' 

^  t€0  t 


(x  )  X^ix  ) 
q  q 


=  E  giA6(t  q)  x^iqS) 

/.  S 

teo 


31.  THEOREM.  Let  p^*f,  i=0,l,..,,n,  be  given  on  the  set  Q.  where 

5  and  Q  are  such  that  condition  i  holds  for  given  sets  E  and  2.  Let 

A,  and  be  as  above.  Let  ^  be  a  subset  of  Q,  with  J  the 

corresponding  subset  of  the  index  set  Q.  such  that  as  above  x  = 

E 

X  E  «/>  •  Then 
jej  ^ 


=  i^E  I  I  S 

jeJi=o  '■  qeo  ^ 


J  "p 


=  if  - 


max-jAC  1,  k,  n,  d) 

weAt  I 

.  ^  J 

} 


i/nAj.  nAd. 

k+l  I 


"  Lk+l  ,  ,V 

TT  max|2— ,  |w^  || 


where  A  =  {  ||w||  <A}  ,  A(l,k,n,4)  and  C  are  as  in  Lemma  27,  and  where  K  is 

li  M  OQ 

as  in  the  proof  of  Propost  ion  16. 


Proof.  In  the  following  let  isr.r'soo,  with  1/r  +  l/r'  =  1  and  l/w 
=  0.  A  bound  for  the  first  term  in  the  splitting  (*)  is 
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l[[  ‘  •V'' 

<J  €Q  O  1  ^  <1  ^ 

=  I  ("A  -  rV  ,l  Kl.  I'’!.'  . 

<I  €0  '•  o  1  ^  <l 

A  bound  for  the  first  factor  of  this  bounding  product  is 

^  '  "^s'S  t 

“  ■  1^4%  £".*») ‘V’]  \,IL  }  1^1. 


We  now  apply  the  definition  of  to  bound 


■  llXgll^ 


S  ^'oo 


Uj>'X 


IU)‘  X 


‘  ="p{77^„  J'  "’Id.- 

X€b  ^i^TTj  A 

q  t€Q  S 


S  sup  {-^  Y. 

xeS  H27r)" 

q  t€Q 


iu’X  iu-x 

+  J"  |e  -  e  ‘’idw 


t(j>'X  Ui’X 


+  S  I  |e  -  e  ‘^Idw 


} 


For  X  €  S  and  ||a)||  <  A  , 

q  II  II 00 

iwx  iW’X 

|e  -  e  ^  |w(x-x  )|  5  |w|  |(x-x  )  |  <  ^^  . 

q  q  2 
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Combining  these  bounds 


ol  ^  ^  ^ 


-  max-<max  sut 

(27r)"  1  Ueg  toes 


(1*2^) 


We  have  11  =  (2X)  ,  and  from  the  proof  of  Proposition  16 

A  1 


l^xM. »  KK  IM.  = 

where,  as  always,  ka3. 

To  bound  the  sup  above  we  observe  that  with  v  =  w-tA  there  exists 
u'  e  ^  such  that 

t 

-  [%^ftJ(tA)|  S  |a^ftj(u')j  s  (w' )  |  Jlw-tA| 

s  mEix  -TlS  .ft  (a)')|lv7i 

„'^aV  '  '/ 


(k+1) „(2-k)n 


By  Lemma  27 


sur 

weE 


{|  C^;^fti](‘0)  -  Cj:;^ftj(tA)l| 


s  max 
Ii>€A 


n  max{C  ,  | w  | } 

f  f  1-1  ^ 

jA(l,k,n,^J)  2^^  ^ 


r_k+l  ,  iV 
TT  max|2— ,  1  Wj  1 1 


"h^A 

k+ij  2 


This  completes  the  bound  for  the  first  term  of  the  splitting  (»), 


For  the  second  term  of  the  splitting  we  first  use 


<  ICO 
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(x  ) 
q 


""  II  h  Jr  II  ^  k*^  -  11,^  • 

q  €Q  b  1  q  q€Q'“  q 

To  bound  |  J]  Hr'  note  that,  with  isv.v'soo,  1/v 

aeo  ^  **  J  ,T  ** 


1/v'  =  1, 


I  Y.  k»Jf(x)  -  [m  (x  )1 

qeo''  j 


?JIC^3tx]  -  ]iv  i^iv'^S 


q€0 


{i-  -  >^,11.}  • 


where  6/2  =  max 
xeS 


(x)  , 


qeQ  q 

The  last  inequality  follows  from  Lemma  10 


and  from  ‘  usual,  all  occurrences  of  a  in  the  last 

“i  ‘ 

expression  may  be  replace  by  m. 

To  bound  II  E  ii^  %  ,  K  ““ 

q  tQ  o  1  q 

{l  ror  I  II.} 

1 .  q  '•  a  1  i  '•i2irl  t€0  -I 

KMl}  ^  ^  [i]  iM. 


To  complete  the  proof,  combine  the  above  bounds  and  use  r'=l  in  the 
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bounds  for  the  first  term  of  the  splitting  (»),  and  use  r  =  v'  = 
the  bounds  for  the  second  term  of  the  splitting. 
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3.8  Discussion 

A  primary  motivation  for  exhibiting  an  explicit  error  bound  was  to 
determine  if  a  ''practical"  support  for  the  deconvolutors 
could  be  established.  A  "practical"  support  would  be  one  for  which  the 
side  length  ^  of  2  differed  from  the  side  length  m  of  the  smallest 
convolutor  by  a  factor  of  several  tens.  Such  a  support  would  be  useful 
for  applications. 

The  bounds  established  here  do  not  satisfy  our  "practical" 
criterion.  Let  us  examine  the  error  c  for  a  specific  case.  Consider 
n  =  2,  d  =  {1,  VSi ,  k  a  3,  and  s  s  l. 


Then 

m  =  1,  H  = 

(see  the  Theorem  in  Approximate  reconstruction  for  definitions) 


2^^  a:  8,  and 
s 


C  = 


rr  ->4  -.1/3 

.(h]  I)  “  \  =  2 


s 


Since  the  side  length  m  =  1  of  the  smallest  convolutor  is  our  unit  in 
IR,  it  is  easy  to  select  a  function  f  and  a  set  E  such  that 

IKIlp  -  and  =  2" 

(e.g.  ,  a  simple  function  with  support  in  E  ).  For  such  a  case  the 
error  e  should  be  no  more  than  1. 

Consider  e^.  In  the  bound  for  given  in  Section  6  the 

quantities  Itj  (x  )  I  and  Itj  (x  )  I  have  the  common  factor 


1  J 


2  J 
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L  =  (n+Dv'n 


(t]i: 


n 


s  1.70  X  10  . 


This  term  also  appears  in  A(r, k, n, d)  so  that 


'(27r) 

-  IK 


n/2  ( n- 1 ) /2  3n+n/2 

3  L  K 


an+n/i:  f  1 

1 


k-3+1/2 


If  k  =  3,  then  for  e  ^  it  is  necessary  that  l-ngCXj)!  ^  Iflg 

requires  that 


In  ^  K  2  8^*  =  2^^ 
1 


For  |tj  (x  )|  to  not  exceed  I?)  (x  )|  it  is  necessary  that 
1  j  2  J 


whence,  for  r  =  2, 


p  2:  («7r) 


1/2 


8®  a 


,21+27 


=  2 
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Clearly,  such  estimates  are  not  "practical." 
for  A  and  5  that  appear  in  the  bound  for  e^. 


which 


Similar  relations  hold 


4  MULTIPLE  OPERATOR  DECONVOLUTION  WITH  ADDITIVE  NOISE; 
THE  ENVELOPE  OPERATOR 


Summary 

The  methods  for  multiple  operator  deconvolution  of  Berenstein, 
Taylor,  and  Yger  are  examined  for  the  case  of  the  addition  of  a  noise 
signal  after  each  of  the  multiple  convolutions  and  preceding  the 
deconvolutions.  It  is  shown  that  for  strongly  coprime  multiple 
operators  there  is  an  obvious  choice  for  optimal  deconvolvers.  The 
case  of  m  strongly  coprime,  parallel  convolvers  with  m  independent 
noise  sources  is  compared  to  that  of  m  identical,  parallel  convolvers 
with  m  independent.  Identically  distributed  noise  sources.  A 
performajice  criterion  is  defined.  The  performance  for  selected 
collections  of  strongly  coprime  convolvers  is  shown  to  be  at  least  as 
good  as  that  for  the  corresponding  collection  of  eui  equal  number  of 
identical,  parallel  convolvers.  That  is,  there  is  no  penalty  for  the 
additional  frequency  response  available  with  deconvolution,  at  least 
for  the  noncompactly  supported  optimal  deconvolvers.  Qualitative 
methods  are  developed  to  characterize  the  properties  of  strongly 
coprime  configurations.  These  methods  enable  the  description  of 
circumstances  in  which  it  is  advantageous  to  use  strongly  coprime 
multiple  detectors  of  large  support. 
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4-.1  Introduction 

Tliroughout  the  last  several  years  mathematical  results  have  been 
presented  which  form  the  foundations  for  the  use  of  multiple  (parallel) 
linear  operators,  each  given  by  convolution  with  a  distinct  kernel  (or 
impulse  response),  in  place  of  the  use  of  a  single  such  linean  operator 
or,  equivalently,  in  place  of  the  use  of  multiple  (parallel)  operators 
each  with  the  identical  kernel  (Kelleher  and  Taylor  1971;  Berenstein 
and  Taylor  1979,  1980a,  1980b;  Berenstein,  Taylor,  and  Yger  1983a, 

1983b;  Berenstein  and  Yger  1983;  Berenstein  1983).  See  Figure  16.  In 
the  multiple  operator  method  each  distinct  kernel  (also  referred  to  as 
a  convolver  or  convolutor)  is  associated  with  a  second  kernel,  referred 
to  as  a  deconvolver.  These  kernels  are  viewed  as  distributions,  that 
is,  as  linear  functionals  on  the  space  of  infinitely  differentiable 
functions  on  (R^.  The  mathematical  results  cited  above  describe  the 
conditions  under  which  compactly  supported  distributions  p  ,  p  , . . . ,  p 

12  m 

have  associated  to  them  compactly  supported  distributions 

V  ,  V .  V  such  that 

12  m 

m 

E  =  5  ,  (1) 

I  =1 

where  5  is  the  Dirac  distribution  on  and  where  »  denotes 

convolution. 

This  is  of  interest  for  applications  in  which  the  convolver  p^ 
must  correspond  to  a  physical,  analog  device  wherein  the  impulse 
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Fig.  16.  (a)  Multiple  parallel  linear  operators  with  distinct 

distributions  .  Single  operator  (t>)  and  multiple  parallel 
operators  with  identical  distributions  (c). 


response  is  dictated  by  a  solid  state  or  biological  process.  It  is 
entirely  possible  to  select  such  analog  convolvers  which  satisfy 
approximately  the  multiple  operator  criteria.  Then  each  associated 
deconvolver  can  be  digitally  implemented.  The  fact  that  the 

deconvolvers  are  linear  and  of  compact  support  means  that  their 
implementation  is  straightforward;  that  they  are  continuous  implies 
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stability.  Most  importantly,  the  evident  high  bandwidth  of  the  overall 
operator  is  accomplished  without  any  essential  change  in  the  response 
functions  of  the  analog  devices.  The  term  overall  operator  refers  to 

m 

the  operator  given  by  the  kernel  distribution  p  •v  =  6  .  Of 

1=1  ^ 

course,  because  of  practical  constraints  such  as  analog  and  digital 
approximations  and  computation  time,  the  design  objective  for  the 
overall  operator  would  not  be  the  identity  operator  with  impulse 
response  5  but  rather  a  high  bandwidth  approximation  of  the  identity 
operator  given  by  an  impulse  response  <j>.  In  terms  of  the  distribution 
equation  (1)  and  since  convolutions  commute 

m  m 

2  *0)  =  <^  .  (2) 

1  1  11 
1=1  1=1 

In  a  sense  <p  can  be  considered  to  be  made  up  of  "parts,  "  each  of  which 
arises  from  one  of  the  practical  constraints  just  listed,  along  with  a 
special  part  that  is  deliberately  added  to  control  the  noise  power 
spectrum  of  the  output  of  the  overall  operator. 

The  publications  on  this  subject  have  appeared  primarily  in  the 
mathematical  literature.  The  following  issues  regarding  (1)  have  been 
addressed:  sufficient  conditions  for  the  existence  of  solutions 

(Hormander  1967;  Kelleher  and  Taylor  1971;  Berenstein  and  Taylor  1979, 
1980a,  1980b);  examples  of  sets  of  distributions  that  satisfy  the 

sufficient  conditions  (Berenstein,  Taylor,  and  Yger  1983a,  1983b); 

construction  of  explicit  solutions,  that  is,  explicit  formulas  for  the 
deconvolvers  (Berenstein  and  Yger  1983;  Berenstein  1983);  and 
construction  and  evaluation  of  approximate  solutions  (Berenstein, 
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Krishnaprasad,  and  Taylor  1984;  Chapter  3  of  this  document). 

Only  recently  have  specific  applications  of  (1)  been  mentioned. 
The  work  of  Berenstein,  Krishnaprasad,  and  Taylor  (1984)  addressed  the 
case  of  one  dimensional  integration  over  an  interval  as  a  linear 
operator  on  a  variety  of  function  spaces.  This  work  was  the  first  time 
that  (1)  and  contemporary  mathematical  methods  for  understanding  the 
equation  were  applied  to  physical  problems.  There  the  linear  operators 
in  (1)  were  considered  to  act  on  function  spaces  other  than  the  space 
of  infinitely  differentiable  functions  c”(IR^).  In  applications  these 
other  function  spaces  may  be  L^’CIR")  (functions  with  modulus  to  the 
power  p  having  bounded  Lebesgue  integral)  or,  more  generally,  Sobolev 
spaces.  The  consideration  of  (1)  acting  on  such  functions  spaces 
requires  the  consideration  of  c”(IR*^)  as  a  dense  subset  and  the  behavior 
of  the  operators  on  the  closure.  Consequently  it  is  natural  that 
approximate  identities  and  mollifiers  such  as  ^  in  (2)  Eire  used.  This 
work  also  discussed  the  question  of  additive  noise  and  the  question  of 
the  continuity  of  the  overall  operator  with  respect  to  the 
distributions  p  ,  p  ,  .  .  .  ,  .  The  noise  question  is  in  regard  to  noise 

12  m 

added  following  the  action  of  the  operators  defined  by  the  while 

the  continuity  question  is  in  regard  to  the  dependence  of  the  overall 
performance  on  either  the  actual  analog  approximations  of  the  or  the 
digital  approximations  of  the  . 

The  approximation  methods  of  Chapter  3  of  this  document  were 
motivated  by  this  work  of  Berenstein  et  al.  These  methods  exploit  the 
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approximation  in  (2).  In  conjunction  with  the  analysis  of  the  methods 

2 

(Chapter  3),  a  computer  simulation  for  R  was  performed.  This 
simulation  drajnatically  illustrated  (2)  for  imaging  devices  in  which 
the  analog  convolvers  were  solid  state  photodetectors.  With  these 
results  there  was  an  increased  interest  in  imaging  applications.  This 
led  to  the  consideration  of  not  just  detectors  but  of  linear  systems 
consisting  of  sequences  of  operators  with  each  operator  of  the  multiple 
operator  type.  These  activities  led  to  the  need  to  answer  basic 
systems  analysis  questions. 

This  chapter  describes  the  result  of  our  application  of  standard 
methods  of  linear  systems  and  random  signals  to  the  multiple  operator 
type  of  system  of  equations  (1)  and  (2).  This  analysis  was  necessary 
if  one  was  to  seriously  consider  multiple  operator  designs.  While  the 
extended  bandwidth  was  well  understood,  analyzed,  and  even  illustrated 
in  simulations,  the  consequence  of  the  introduction  of  noise  and  of 
design  errors  was  not  fully  understood.  It  was  clear  that  since  the 
operator  was  linear  and  continuous  that  there  would  be  no  instablity 
due  to  noise  (at  least  for  smooth  (c'”(r'^))  approximations),  which  is 
already  an  improvement  over  the  case  of  single  operator  reconstruction 
methods  (Berenstein,  Taylor,  and  Yger  1983a;  Berenstein,  Krishnaprasad, 
and  Taylor  1984).  However,  the  performance  needed  to  be  explicity 
described  so  that  standard  tools  such  as  resolution,  equivalent 
bandwidth,  and  signal  to  noise  ratio  would  be  available  for  systems 
engineering  design  studies. 


194 


4.1  Introduction 


This  investigation  was  motivated  in  large  part  by  the  potential 
application  of  these  multiple  operator  methods  to  electo-optics, 
especially  to  imaging  devices.  We  have  in  mind  imaging  devices  that 
are  for  the  detection,  transformation,  and  display  of  electromagnetic 
radiation  for  a  human  observer  as  well  as  such  devices  for  artificially 
intelligent  "observers."  Consequently,  the  problems  emd  the  desired 
solutions  have  the  flavor  of  this  application.  While  the  analysis  and 
the  results  are  in  a  sense  general,  much  is  fraimed  and  guided  by  the 
motivating  problems. 

With  this  in  mind,  let  us  review  two  features  of  performance 
descriptions  suitable  for  engineering  studies.  For  imaging 
electro-optics  systems  it  is  best  to  cast  off  any  hope  and  preference, 
common  in  mathematics,  for  an  obvious  choice  of  norm  or  metric  as  a 
performance  measure.  First,  performance  criteria  are  never  uniquely 
determined  by  the  device:  they  depend  instead  on  the  infinite  number 
of  possible  end-uses.  Loosely  speaking,  if  there  are  two  end-uses  that 
are  "linearly  independent,"  then  one  would  need  at  least  either  two 
real  valued  performance  metrics  or  a  performance  criterion  that  takes 
values  in  a  2-dimensional  space.  For  example,  for  field  use  of  an 
infrared  imaging  device  for  observations  in  a  natural  terrain,  there  is 
a  requirement  for  good  sensitivity  at  low  spatial  frequencies  for 
purposes  of  orientation  and  search  strategy  relative  to  the  terrain, 
while  there  is  a  requirement  for  sufficient  response  at  sufficiently 
high  spatial  frequencies  for  purposes  of  accomplishing  the  objective  of 
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the  observation  (Ratches,  Lawson,  et  al.  1975).  These  two  sub-uses  of 
field  use  are  an  example  of  two  "independent"  uses.  A  different 
end-use,  say  industrial  robot  vision,  would  surely  have  distinct 
sub-uses  that  were  independent  of  those  in  the  field  use  example. 

The  simplest  thing  to  hope  for  is  a  performance  criteria  that  can 
be  "projected"  onto  any  of  the  criteria  "spanned"  by  a  set  of  end-uses. 
Consequently,  it  is  typical  in  electo-optics  to  use  functions  to 
characterize  devices  and  systems  and  to  rarely  be  satisfied  with  a 
choice  of  norm  of  the  function,  or  even  with  a  choice  of  a  projection 
of  the  function  to  a  finite  dimensional  space.  In  other  words,  one  is 
willing  to  forego  a  linear  ordering  of  devices. 

The  trsuisfer  function  (the  Fourier  transform  of  the  impulse 

response)  and  the  noise  power  spectral  density  are  familiar  examples  of 

such  device  characterizing  functions.  (The  second  may  depend  on  a 

background  signal  level  as  well  as  the  device. )  The  minimum  resolvable 

temperature  difference  is  another  such  function.  (A  human  observer  is 

assumed  for  this  one, )  The  simiplest  example  of  a  projection  is  the 

"evaluate  at"  map;  for  example,  evaluating  the  modulus  of  the  transfer 

function  at  a  specific  frequency  projects  the  space  of  all  transfer 

functions  onto  the  real  numbers.  Evaluating  a  weighted  sum  of  such 

projections  is  a  further  example.  While  the  set  of  all  transfer 

functions  in  not  naturally  ordered,  it  inherits  an  order  from  a  fixed 

2 

choice  of  such  a  projection,  as  well  as  from,  say,  the  L  norm.  The 
characterization  of  a  device  by  such  dimension  reducing  projections  is 
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almost  always  inadequate;  one  prefers  to  see  the  system  in  terms  of  its 
chsiracterizing  functions. 

On  the  other  hand,  system  characterizations  typically  have  eui 
implied  equivalence  relation.  A  familiar  exsimple  of  such  an 
equivalence  relation  is  the  one  in  which  transfer  functions  that  differ 
by  a  consteuit,  nonzero  multiple  are  identified  (hence  the  use  of  the 
familiar  signal  to  noise  ratio).  That  is,  by  means  of  a  suitable 
equivalence  relation  one  seeks  to  factor  from  the  characterizing 
functions  all  irrelevant  differences.  (In  the  example,  any  difference 
in  gain  is  to  be  neglected.  )  Frequently  the  equivalence  classes  are 
identified  by  a  standard  choice  of  normalization.  (In  optics,  transfer 
functions  are  normalized  to  unity  at  zero  frequency. )  The 
identification  and  use  of  equivalence  classes  reduces  the  size  of  the 
space  of  the  characterizing  functions. 

The  objective  of  this  chapter  is  to  provide  explicit  performance 
characterizations  for  multiple  operator  deconvolution  in  the  presence 
of  additive  noise.  In  addition  to  the  two  features  above  (functions, 
equivalence  classes)  that  are  to  be  incorporated,  a  third  is  that 
characterizations  are  always  relative:  the  whole  point  of  any 
characterization  is  comparisons.  Our  objective,  then,  is  to  provide  an 
explicit  performance  characterization  for  multiple  operator 
deconvolution  relative  to  the  performance  of  any  of  the  constituent 
single  operators.  Once  this  is  accomplished  the  existing  comparisons 
between  conventional  single  operators  can  be  used  to  compare  multiple 
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operators  with  arbitrary  single  operators.  And  our  goal  is  to  do  this 
with  wisely  chosen  equivalence  classes  so  that  succint  engineering 
conclusions  can  be  formed  directly  from  the  characterizing  functions. 
This  goal  is  accomplished  in  this  chapter  by  the  use  of  what  we  call 
the  envelope  operator  (and  the  equivalence  class  it  generates) 
associated  with  a  multiple  operator.  With  this  construction  the 
comparison  task  is  reduced  to  a  compEU'ison  of  treinsfer  functions. 
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4.2  General  results 

A  fundamental  result  in  this  subject  is  the  following.  Given  a 
set  of  distributions  pi,  on  r",  each  with  compact  support, 

12  nk 

then  the  necessary  and  sufficient  condition  for  the  existence  of  a 
second  set  of  distributions  u  ,  v . v  on  R”,  again  each  with 

12  n 

compact  support,  such  that 

m 

x;  =  5  ,  (1) 

1=1 

is  that  the  Fourier-Laplace  transforms  of  the  denoted  satisfy 
m  -C  I Im  z| 

Z  |Pj(z)|  £  C^e  ^  (1+lzl)"''  .  z  €  C"  (3) 

1=1 

for  some  positive  constants  C^,  C^,  auid  N  (Hormander  1967;  Kelleher  and 
Taylor  1971).  (For  <  =  (C  ,  C . C  )  e  c"  define  ICI  = 

12  n 

E  •)  The  condition  (3)  is  often  referred  to  as  the 

strongly  coprime  condition. 

Here  we  will  need  only  elementary  hanmonic  analysis  and  we  shall 
consider  the  Fourier  transform  on  R",  that  is,  the  restriction  of  the 
Fourier-Laplace  transform  to  r"  c  c"  in  the  sense  that  for  z  =  (z^, 
z  , .  .  .  ,  z  )  e  c”,  <j>  =  (w  ,  (j)  ,  ,  (i)  )  =  (Re  z  ,  Re  z .  Re  z  )  e  R". 

2  n  12n  12  n 

Then  (3)  has  the  form 

J]  lp^(w)|  a  C^(l+|w|)  ^  ,  w  e  r”  .  (4) 

1=1 

For  any  distribution  v  of  compact  support,  0  €  c”(R").  As  usual, 
we  may  choose  <f>  €  c”(r")  such  that  ^  has  compact  support  and  is 
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sufficiently  differentiable  so  that  v»<l>  e  L^(IR”).  But  can  not  have 
compact  support.  However,  for  each  i=l,2,...m  define  h^  =  e 

L^(IR").  Then 


E  (5) 

1 

The  hj  6  L^(IR")  that  satisfy  (5)  are  not  imiquely  determined. 
From  (4)  and  from  e  C^CIR”)  and  with  0  8is  above,  the  choice 

Mj(w) 

D  (u)  =  -  ,  ft  (w)  =  D  (w)$(w)  ,  i=l,2 . m,  (6) 

In  i  1 

j=i  ^ 

defines  functions  h^  e  L^CR")  which  satisfy  (5).  (z  denotes  the 
complex  conjugate  of  z. ) 

While  (6)  is  exhibited  essentially  by  inspection,  the  result  can 
be  obtained  in  a  more  systematic  fashion  as  well  as  in  a  more  general 
form.  We  first  recall  some  standard  tools,  apply  these  tools  to  a 
simple  case,  and  then  proceed  to  the  more  general  form.  The  diagram  in 
Figure  17  represents  an  operator  L  acting  on  a  function  f.  Let 
(temporarily)  f  be  bounded  and  in  c”(r").  Let  p  ,  p . p  be  an 

12  m 

arbitrary  set  of  m  distributions  with  compact  support.  For  each  linear 

operator  defined  by  p^  let  tj^  be  a  sample  function  of  a  zero  mean, 

wide-sense  stationary  random  process  that  is  added  to  the  output  of 

p^  ,  let  7}^  e  L^CR"),  and  let  (N^  a  0)  be  the  noi  se  power  spectral 

density  of  the  process  (see,  for  example,  Davenport  and  Root  1958, 

Ch.4,  Ch.6).  For  each  distinct  i  and  j  let  7)^  be  independent  of  7)^  and 

let  each  t)  be  independent  of  f.  Let  v  be  defined  by  (y  *6)'^  =  D  ft  . 

J  1  i  r 
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Fig.  17.  Multiple  operator  configuration  consisting 

of  m  paLrallel  convolvers  ,  m  noise  signals  7)^,  and 

m  deconvolvers  v  . 

1 

where  e  C^(R^),  ^  has  compact  support,  emd  r  is  sufficiently 

large  so  that  e  L^(R").  Let  g  e  l”(R")  be  defined  by 

m 

g  =  Lf  =  (Pj»f  +  .  (7) 

1=1 

In  the  usual  manner,  with  E  denoting  expectation, 

m 

E-{g>  =  X)  Pj»f*(yj»^) .  (8) 

y 

Let  T'  denote  translation  by  y,  T'(x)  =  x  +  y  ,  let  denote  inverse 
y  y 
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Fourier  transform,  and  let  ||  |  denote  the  L**  norm.  Directly  from  the 
definition  of  wide-sense  stationary  and  noise  power  spectral  density  it 
follows  that 


E-fCg  -  E{g}}j^(;g  -  E{g>]oTjj.  =  '"(y)  . 


(9a) 


and,  for  y  =  0,  that 


E(Cg  -  E{g}]^j  =  EN^IDJ^I^I 

t  J  (27r)  1=1 


(9b) 


The  simplest  configuration  for  L  is  all  distributions  equal,  all 
deconvolvers  trivial,  and  all  random  processes  identically  distributed: 

=  5  ,  Nj  =  .  for  i  =  1,2,  .  .  .  ,m  .  (10) 

Then 


E(g}  =  ,  E-j^^g  -  E{g})^j-  = 


m 


(27t) 


(11) 


The  utility  of  (8)  and  (9)  or  of  (11)  is  that  if  L  is  followed  by 
a  linear  operator  U  with  kernel  u  (which  could  model  a  specific 
"end-Use")  then  classical  discrimination  methods  would  compare  the 
function  [u(E{g})]^  with  the  constant  function  E-|[u[g-E{g}])^j-.  In  the 

case  of  the  simplest  configuration,  (10)  and  (11),  there  are  the 
following  formulas  and  bounds. 


[U(E{g})]^  =  E{Ug}^  =  [w*(mp^*0*f  )]^  =  m^  '^j  ‘ 

^  r_ji_  1,^^  1" 

^  (27r)"  ° 


(12) 


:£  - ^1^  Hup  ^11^  11^1^  when  f  e  L^(1R")  ; 

I-  (27r)"J  °  ^  ^ 
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and 

E|[u(;g  -  E<g}]]^J.  =  .  (13) 

The  function  E{Ug}  is  referred  to  as  the  signal,  its  square  E{Ug}^ 
is  referred  to  as  the  signal  power  or  energy,  and  e|^ [U [g-E{ g> ] ] ^ j-  is 

referred  to  as  the  noise  power.  Typically  the  ratio  of  E'dlg}^  to 
E|[U[g-E(g>]]=}  is  considered,  or,  alternatively,  the  positive  square 

root  of  the  ratio.  Here  we  shall  consistently  use  the  latter.  If  this 
ratio  is  evaluated  at  some  distinguished  point,  the  value  defines  a 
"signal  to  noise  ratio. "  We  denote  by  p  the  projection  of  a  function 
by  the  evaluation  of  the  absolute  value  of  the  function  at  the 
distinguished  point.  Given  L  and  for  a  given  choice  of  0,  f,  U,  and  p 
define  the  signal  to  noise  ratio 

^ -  .  (14) 

r 

E|(u[g-E{g}]]^| 

«  . 

For  a  fixed  choice  of  <p,  f,  U,  and  p,  two  operators  L  and  L'  can  be 
compared  and  ordered  by  (14). 

On  the  other  hand,  for  a  choice  of  <t>,  f,  U,  and  p,  (14)  is 
determined  for  the  case  of  the  trivial  operator  in  (10)  by  the  pair  of 
functions 

m  and  .  (15) 

In  general,  let  operators  L  and  L'  (for  example,  as  in  Figure  17)  have 

transfer  functions  and  noise  power  spectral  densities  p,  and  p' , 

2 

N'  ,  respectively.  For  a  choice  of  U  we  shall  say  that  UL|UL' 


4,2  General  results 


203 


(i.e.,"UL  divides  UL'")  if  there  exists  a  function  q  €  L*”(IR")  such  that 
u  q  A  =  ^  fi'  •  If  liL|llL'  and  jq|^|u|^N^  s  |u|^N'^  ,  we  say  that 
UL  £  UL'  . 

This  definition  is  motivated  by  the  following.  As  usual,  let  (f>  be 
such  that  a  linear  operator  a  with  kernel  q  can  be  associated  with  q  by 
considering  qA  .  Let  8  be  any  continuous,  translation  invariant. 


linear  operator. 


For  fixed  U  if  UL  £  UL'  , 


yA^??(u8aL)  ^  ^ 


Consequently,  sup^A'JiCUSL)  a  sup  y’A'KCUSL' )  . 

8  8 

Next  consider  the  operator  L  diagrammed  in  Figure  17  for  the  case 
in  which  p  ,  p  , ...,p  are  distinct  and  strongly  coprime  (i.e.,  satisfy 

12  m 

m 

A  2 

(3)).  An  obvious  consequence  is  Y.  >  0  Euid,  equivalently, 

1=1 


0  *  (fl  (u),  p  (u) . p  (w))  e  c”  ,  u  €  r"  . 

12  ID 


(16) 


Consequently  we  can  visualize  (16)  as  is  shown  in  Figure  18a.  A 

similar  illustration  can  be  used  to  visualize 

^(u)  (p  (cd) ,  p  (w) . p(c<)))  =  (^(w)p  (w),  ^'(w)p  (w) . ^(w)p(w)), 

1  2  m  12  m 

except  the  "curve"  passes  through  the  origin  if  and  only  if  ^(w)  =  0. 

2 

The  power  spectral  densities  are  real  and  nonnegative  (thus  we  write 
and  choose  £  0).  Assume 


N^(w)  >  0  ,  w  €  r"  ,  i  =  1,2 . m  .  (17) 

We  can  visualize  (17)  as  is  shown  in  Figure  18b.  The  case  of  strongly 
coprime  multiple  operators  has  the  useful  feature  that  the 
consideration  of  (16)  and  (17)  pointwise  in  conjuction  with  (8)  and  (9) 
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uniquely  determines  eui  alternative  choice  for  the  of  (6).  This 
choice  will  be  optimal  in  the  sense  it  has  the  smallest  E-| fg-E{ g> ] 

among  all  sets  of  deconvolvers. 


Figure  18 


PROPOSITION.  For  e  l"(IR"),  N^(w)  >  0  for  u  e  r”,  i  = 

l,2,...,m  ,  then  D  :  r"  - >  c“  is  uniquely  determined  (almost 

everywhere)  by  the  conditions,  for  fixed  w  €  r", 

D(cj)  =  (D  (u),  D  (w) . D  (w))  =  z 

12  m 

minimizes  |zj  N^(w)  on  the  set  -Iz  €  c"*  :  z  jii  (w)  =  1  I  .  (18) 

1=1  I-  1  =  1  '  ^  J 
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In  fact 


DjCw)  = 


N^(w) 


m  |/i  (w)|^ 

y  — i - 


(19) 


E 

1=1 


N^(w) 


Proof:  Any  z  that  satisfies  (18)  is  clearly  contained  in  the 

linear  subspace  of  c"  determined  by  the  span  of 


(Aj(w).O,  .  .  .  .0).  (0.A2(w).0 . 0),...,  (0,0,  .  .  .0,A^(w))  I  . 


(20) 


That  is,  =  0  if  /i^(w)  =  0.  Equivalently,  there  exists  X  = 


(X  ,  X . X  )  €  C  such  that 

12  tn 


fz  N  (w),  z  N  (w),...,z  N  (w)]  =  fx  A,  (w),  X  A„(w) . ^  A  («)]  •  (21) 

^11  22  mm-'  '•11  22  mm*' 


Let  J]'  denote  .  Then  (18)  implies 


1  =  1 

Aj (w)^0 


A  f  X  1 2 

P,  (w) 


r  I  ^  i,  I  -v 

minimize  ^  1^  I  Aj  (w)  on  |  J]'Xj— =  1  | 


(22) 


From  this  it  follows  that  the  X^  are  all  real,  so  that  (22)  in  the  form 


r  [A  (“) I  I 

minimize  E' [aJ Aj (w)  |]^  on  ]  E'^JMj(w)|  =  1  [ 

1  '■1  1  -> 


(23) 


is  an  elementary  case  for  (R  and  has  the  unique  solution 
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|A,(^)| 

N  (w) 

X  Ijj  («)  I  =  - - - —  (for  (u)  *  0)  .  (24) 

‘  ‘  «  |A,(6>)|^ 

E  — - - 

j=i  N^((<)) 


Consequently,  from  (21),  the  unique  z  corresponding  to  the  minimum  is 
D((i>)  as  in  (19).  ■ 


In  addition  to  N  >  0,  i  =  l,2,...,m  ,  we  shall  assume  N  >  0. 

1  0 

Further,  we  shall  assume  that  the  EU'e  sufficiently  differentiable 
and  that  -j^  =  0(|«|'*)  for  some  integer  p,  i  =  0,l,2,.,.,m  .  With  this 

we  can  find  ^  =  0(  |u|  '*’  )  so  that  (D^^)^  6  L^(IR”)  and  for  $ 
sufficiently  smooth  and  with  compact  support  then  (D^^)'^  e  L^(IR”). 


COROLLARY.  For  the  choice  of  from  the  Proposition, 


i=i  '•  1=1  J 


1/2 


lA  .2 

IXjl 


j=i  N 


1/2 


(25) 


Let  L  identify  the  trivial  configuration  of  L  in  (10)  and  let  L 

0  s 

identify  the  strongly  coprime  configuration.  Unless  explicitly 
indicated  to  the  contrary,  L  indicates  that  the  deconvolvers  D  of 

S  1 

(19)  are  used.  The  first  of  the  functions  in  (25)  is  the  transfer 
function  for  L  and  the  second  is  the  square  root  of  the  noise  power 

S 
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spectral  density.  The  corresponding  functions  for  are  (15).  The 
mollifier  ^  is  suppressed  but  understood.  From  (25)  obviously  L  |L  for 

S  ’ 

any  operator  L.  (Note  that  L  always  denotes  a  pair,  a  transfer 

function  (linear  operator)  and  an  additive  noise. )  From  (15)  and  (25) 

the  dividend  q  for  L  =  is  mp^.  Let  denote  the  noise  power  spectral 

density  of  L  .  In  the  sense  discussed  earlier  let  Q  denote  the  linear 
s  0 

operator  associated  with  mp^  .  That  L  |L^  with  dividend  mp^  means  = 
a  L  .  Then  Q  L  has  functions  corresponding  to  (25)  (transfer 

Os  Os 

function,  square  root  of  noise  power  spectral  density)  given  by 


m 

A  «  A  ^  A 

mu  V  /i  D  =  mu  , 
1=1 


(26) 


By  definition  UL  a  UL  if  Imu  |N  (w)  s  v^N  (w)  on  the  support  of  u, 

and  UL  s  UL  if  UL  lUL  and  Imu  |N  (w)  ^  VmN  (w)  on  the  support  of 
0  s  O^s  O  s  0 

u.  Thus,  whether  UL  £  UL  or  UL  i  UL  holds  depends,  in  part,  on 

0  s  s  0 

whether  one  of  the  following  inequalities  holds  on  the  support  of  u  : 
from  (15)  and  (26) 

Imp  In  (w)  “  V^nN  (u)  <==> 

'  0 '  s  —  0 


I 

M  =1 


N^(w) 

0 

N^(w) 


p^(u) 


2 


•V  1/2 


v^i|p^(w) 


(27) 
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In  (27)  the  notation  means  that  the  upper  Inequality  symbol  on  the  left 
is  to  be  paired  with  the  upper  inequality  symbol  on  the  right  and  lower 
left  with  lower  right. 

The  comparison  in  (27)  can  in  special  cases  be  viewed  from  a 
slightly  different  perspective.  First,  view  the  left  side  of  the 
second  inequality  in  (27)  as  the  Fourier  transform  of  a  kernel.  Define 


e(u)  = 


^  “  N^(6)) 

[— i - 

^  1=1 


1/2 


(28) 


We  refer  to  e  as  the  envelope  transfer  function  corresponding  to  the 
envelope  operator  <S  for  a  given  strongly  coprime  L  in  comparison  with 

S 

a  given  L  .  If  Vm<S  acts  on  L  ,  then  the  pair  of  functions  associated 
0  8 

with  i/rnffL  is 

S 


V^i  e 


N 

0 


(29) 


Recall  that  the  pair  for  is  given  by  (15)  (rewritten  for 


convenience) 


m  .  (15) 

That  is,  the  composition  of  with  L  has  a  noise  power  spectral 

S 

density  equal  to  that  of  .  If,  for  example,  is  real  and 

positive,  then  it  maJces  sense  to  compEre  (29)  with  (15).  It  is  easy  to 
check  that  the  condition  uVme  £  (on  the  support  of  u)  coincides 

with  our  definition  UL  a  UL  ,  and  ump  £  uVmc  coincides  with  what  we 

s  0  0 

mean  by  UL^  s  UL  .  These  two  inequalities  are  precisely  the  content 
of  the  comparison  of  the  right  side  of  (27).  One  could  say  that  is 

the  normalization  of  L  to  the  noise  power  spectral  density  of  L  . 

s  0 
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For  either  point  of  view  we  consider  e  r":  e(w)  £ 

Vm|fi^(t<))  ij-  and  =  -|^u  e  r":  e(w)  ^  ||-  .  For  all  U  such  that  u 

has  support  in  W  it  follows  from  (27)  amd  the  definitions  that  UL  s 

>  s 

UL^  .  Consequently, 

L  )  I  u  $  N  I 

yz/nTiL  )  A 

0  4 

A  O 


■  ^  1  ,  (30) 

2 


where  0^  is  used  to  denote  the  linear  operator  corresponding  to  the 

transfer  function  mu  of  L  . 

0  0 

Assume  u  (0)  *  0  and  define 
0 

=  I  u  e  r"  :  Vt  €  [O.D  lApCtw)!  >  0 

Note  that  for  R^  the  usual  definition  of  limiting  resolution  is  sup 
If  supp(u)  is  compact  and  supp(u)  c  then  UQ”^  makes  sense, 

consequently  UL^|UL^  .  Hence,  if  supp(u)  is  compact  and  supp(u)cW^nn^, 
then  UL  a  UL  .Consequently, 

0  s 


S 

y’;\^x(ua'Y  ) 
0  0 


A 

tt 


(31) 


In  general  the  inequality  cannot  be  extended  to  all  of  because  of 

the  behavior  of  1/  on  the  boundary. 
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There  is  no  information  regarding  - —  implied  by  either 

y//fHVL  ) 

0 

UL  a  ilL  or  TIL  a  UL  .  Additional  information  is  needed.  For 

s  0  Os 

example,  it  may  be  sufficient  to  know  the  effect  of  the  so-called 

"boost"  UL^  I — >  .  In  particular,  if  supp(u)  is  compact  and 

supp(tt)c£2  then 
0 

supp(u)  c  W  and  - ^ — —  s  1  =»  - —  £  1  ,  (32a) 

^  )  ^A^KCUL  ) 

0  0 

and 

) 

supp(u)  c  W  and  - ^ — —  s  1  ==»  - —  s  1  .  (32b) 

^  )  yMniiL  ) 

0  0 

For  supp(u)  c  (R"-fi  ,  or  even  for  supp(tt)n(IR"-n  )  *  0,  it  is  often 
*  0  0 

the  case  in  applications  that  UL  is  not  defined.  Since  UL  is  defined 

for  all  U  it  makes  sense  in  such  cases  to  consider  UL  2:  UL  . 

s  0 
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4-.3  Examples:  Characteristic  functions  of  sets  in  r" 

Collections  of  sets  in  r"  such  that  the  cheiracteristic  functions 

of  the  sets  in  the  collection  are  strongly  coprime  have  been  reported 

(Berenstein,  Taylor,  and  Yger  1983a,  1983b;  Chapter  3  herein).  For 

exajnple,  such  a  collection  of  cubes  consists  of  m  =  n+1  cubes  in  r" 

with  sides  parallel  and  with  side  lengths  Va^ .  v'i”',  where  for 

all  i^tj  and  a^  are  relatively  prime  integers  Euid  for  all  i  Va^  is 

not  an  integer.  A  second  example  is  the  collection  of  m  =  2  disks  in 

R^  where  the  ratio  of  the  radii  is  an  integer  between  2  and  200. 

A  common  situation  for  electro-optic  detectors  on  R"  [e.g. ,  n=l 

(slits),  n=2  (focal  plane  arrays),  n=3  (R^x{time})]  is  for  the  noise 

power  spectral  density  to  have  the  form  >  where  ||;tg||j  is  the  L 

norm  of  the  characteristic  function  of  the  set  S  (equivalently,  the 

Lebesgue  measure  of  the  set).  For  such  a  case,  let  sets  S^,  S^,..., 

S  ,  be  chosen  so  that,  for  /i  =  X  »  the  u  ,  p  ,  .  .  .  ,  p  are  strongly 
m  1  S  1  2  m 


coprime.  Then,  from  the  Proposition, 
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and  (25)  becomes 


®  ^  ®  ^ 

»  1  .  E  IH.I  N, 
1=1  '■  1=1 


1/2 


■ 


1/2 


N. 


0 


(34) 


Let  S  be  any  set,  let  p  =  x  be  its  characteristic  function,  and 

consider  this  to  be  the  convolver  in  defined  by  (10)  (i.e.,  m 

parallel,  identical  convolvers).  Let  the  noise  power  spectral  density 
have  the  same  form  as  above,  N  =  llu  |  N  .  From  (27)  and  (28)  one 
obtains  an  envelope  transfer  function  and  the  associated  comparison 

II  II  1/2 

for  these  two:  a  convenient  renormalization  by  the  constant  u  is 

•'  II  r-Q  II  j 

made  in 


A  ,  ,  e(w) 

11*0  II, 


m  I A 


I 


1  =1 


Mj(w) r 


1  “1 


1/2  I  ^  \  I 

>  ^  !%'">! 

^  vm  - 

i^i:" 


(35) 


For  an  explicit  example  let  c  R  be  the  region  in  a  focal  plane 
of  an  imaging  device  which  corresponds  to  a  single  light  sensitive 
detector.  The  exposure  time  interval  is  assumed  fixed  and  the  image  is 


assumed  constant.  Then  is  the  idealized  response  function  of 


1 

the  detector.  (The  actual  shape  of  the  response  function,  if  not 
deconvolved,  is  incorporated  into  the  mollifier  (p.  )  Then  is  what  is 
referred  to  as  the  "detector  MTF"  and  the  form  of  the  noise  power 
spectral  density  corresponds  to  typical  detector  properties  such  as 
"D  "  for  infrared  detectors.  The  density  has  the  above  form  as  well 
for  the  so-called  background  limited  case.  It  also  has  this  form  for 
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3 

R  when  the  time  interval  is  included  as  the  third  dimension.  Further, 
a  backgroiand  limited  slit  detector  corresponds  to  the  above  forms  for 
R^  with  the  slit  width  as  the  coordinate.  (In  the  background  limited 
case  there  is  assumed  to  be  a  relatively  small  signal  of  interest 
superimposed  on  a  relatively  large  constant  signal  so  that  the  noise  in 
the  signal  of  interest  is  due  to  the  "shot"  noise  of  the  constant 
signal.)  (For  detector  characteristics  discussed  above  see,  for 
exajnple,  Kingston  1978,  Ch.2.) 

In  Figures  19  and  20  the  transfer  functions  for  such  cases  are 
shown.  In  Figure  19,  a  comparison  is  shown  for  the  example  for  R^. 
The  characteristic  functions  and  for  the  two  intervals  [-1  ,  l] 
and  [-v^  ,  ,  respectively,  are  strongly  coprime.  The  envelope 

transfer  function  e  is  shown  and  is  compared  with  the  transfer 

d 

function  for  the  two  identical,  parallel  convolvers  as  in  (35)  where  p^ 

=  p  .  The  choice  p  =  p  is  used  rather  than  p  =  p  in  this 
1  0  1  0  2 

comparison  because  p^  is  "better"  than  p^  in  the  sense  that  the  first 
zero  of  (i.e.,  its  bandwidth)  is  greater  than  the  first  zero  of  p^. 
Recall  from  the  scaling  property  for  Fourier  transforms  on  R^  that 

p^(x)  =  fx^(v^x)  for  all  x  e  R^  if  and  only  if  v^^(v^w)  =  P^(<^)  for  all 

w  e  R^.  Figure  19  illustrates  the  consequence  of  the  strongly  coprime 
condition:  the  envelope  response  is  approximately  an  envelope  for  the 
modulus  of  the  other  two  responses  and,  correspondingly,  is  without 
zeroes.  Also,  it  can  be  observed  that  the  envelope  response  decreases 
approximately  as  l/|w|  . 
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Fig.  19. 
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In  Figure  20  the  envelope  transfer  function  is  shown  for  an 

example  in  the  case  of  three  squares  Q  ,  Q  ,  Q  of  side  length  1, 

}/2,  V3,  respectively.  The  characteristic  functions  of  these  three 

squares  are  strongly  coprime.  The  comparison  (35)  is  illustrated  in 
Figure  20  by  graphing  the  modulus  of  the  corresponding  transfer 
functions  for  two  subsets  of  :  the  w^-axis  ■^a)=(w^ ,  e  R  : 

(see  Figure  20a)  and  the  diagonal  |ti)=(t<)^, w^)  e  R^  :  w^=W2j'  Figure 

20b).  All  graphs  use  the  Euclidean  distance  as  abscissa,  |w|  = 

The  comparison  illustrated  in  Figure  20  is  for  =  ^^  • 

(As  before,  %  has  the  greatest  bandwidth  and  the  scaling  property  for 

r”  has  the  form  u  (x)  =  u  (kx)  for  k  >  0  and  for  all  x  e  R"  if  and  only 
1  2 

if  k"w  (kw)  =  u  («)  for  all  w  e  r”.  )  The  comparison  is  essentially  the 
'^1  2 

sajne  as  that  for  the  two  intervals  in  R^.  The  difference  between  the 

u^-axis  and  the  diagonal  illustrates  that  approximately  the  envelope 

-1  —2 

response  decreases  as  lw|  along  the  w^-axis  and  as  |w|  along  the 
diagonal . 

From  (35)  (and  as  illustrated  by  the  figures)  the  following 
statements  cein  be  made.  These  are  stated  as  "observations"  because  the 
results  can  not  be  given  in  terms  of  explicit  inequalities.  Some 
notation  is  helpful.  Define 


e  r"  :  Vt  e  [0,1] 


(tw) 


and  Q 


m 

=  n  n 

1=1 


(36) 
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Fig.  20b.  (R  ;  abscissa  =  diagonal  solid  =  e  ;  broken:  Vo" 
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OBSERVATIONS:  Let  u,  6  L^(IR")  be  strongly  coprime 

12  in 

characteristic  functions  of  sets  in  r"  as  considered  above.  With  each 

let  there  be  associated  as  in  Figiire  17  an  additive  wide-  sense 

stationary  noise  with  noise  power  spectral  density  of  the  form 

.  Let  L  be  the  conf igxiration  in  Figure  17  with  deconvolvers 

determined  by  the  Proposition.  Let  be  the  trivial  configuration  as 

in  (10)  with  p  =  p  ,  N  =  N  . 

^0  *^10  1 

Observation  1;  For  U  with  supp(u)  c  0  ,  UL  a  UL  . 

s  0 

m 

Observation  2:  For  U  with  supp(u)  c  r”  -  U  fl  ,  HL  a  UL  . 

1  s  0 

1=2 

m 

Observation  3;  For  U  with  supp(u)  c  U  n  -  £1  ,  UL  s  UL  . 

i  s  0 

1=2 

Observation  4:  For  U  with  supp(u)  compact,  supp(u)c  £1^,  let 

be  the  boost  on  U  ,  UL  i >  lUl  ^L  (see  (31)  and  (32)  ).  If 

0  0  0 

Observation  3  can  be  neglected  then 

y;VR(Ua“^L  )  y/ZniTlL  ) 

- i-^sl  ^  - ^^1. 

0  0 

As  discussed  at  (31)  it  is  not  possible  to  extend  this  to  all  of 
£2^,  for  p^  =  0  on  the  boundary  of  Q^.  However,  it  still  is  desirable 

to  have  a  means  to  compare  L  with  the  more  well  known,  more  thoroughly 

S 

studied  trivial  configurations.  In  the  next  section  this  is 

accomplished  by  pushing  the  troublesome  set  {p^  =  0}  out  toward 


infinity. 
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AN  EXPLICIT  EXAMPLE 


It  is  instructive  to  consider 


S 

0 


for  some  explicit 


choices  for  N  ,  f,  U,  and  for  C.  Let  N  be  the  constant  function.  For 
0  0 

fixed  w  €  r",  iet  f(x)  =  1  +  exp(io)  ‘x),  x  e  r”.  Let 

0  0 

pU(E{g})  =  I  [U(E{g} )] (0) I ,  and  let  u  =  be  the  characteristic 

function  of  the  punctured  (excludes  w  =  0)  closed  disk  centered  at  the 
origin  and  of  radius  £,  <  £.  [Alternatively,  the  punctured  cube 

of  side  lenght  2£,  or  the  set  -^weR”  :  |a>^  ,  i=l,  2,  .  .  .  ,  nj-  .  This 

latter  alternative,  the  characteristic  function  of  the 

set  €  R^:  |w^|  s  2|«^|  ,  |«^|  s  f(x)  =  1  + 

exp[ix^(u^)^] ,  is  a  very  coarse  approximation  of  a  standard  vision 

model  (Hatches,  Lawson,  et  al.  1975).]  Then  from  (14),  (34),  and  (35), 


with  C  a  constant. 


yjV^i(UL  )  =  C 

S 


|^(w^)u(w^) 

irrrr 


y>A'mnL  )  =  c 
0 


|$(w  )  p  (w  )  u(w  ) 
'  0  10  0 

II  ^ « N„  11 


hence 


yA^K(UL  ) 


yA'^iCUL  ) 
0 


II » » II3 
I  II  ^  ^ 


For  the  examples  above,  with  2)(ci))  = 


*®|w,("o)|  1 


-  -  ,  for  (jen  , 

1/2  A  -  ,  1’ 

1  ‘d‘"> 
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2)(u^)  a  1,  2)C«)  ^  1  for  |(j|  ^  I^qI*  ^  1  for  |(t>|  a  I^qI' 

y’A'jidiL  )  y/zncoL  ) 

Qualitatively  - ^  a  1  for  t  =  jw  |  ,and  - ^  s  1  for  I  = 

yw'KdiL  )  y/fncuL  ) 

0  0 

Iw^l  +  A  and  for  A  sufficiently  large.  This  exeonple  highlights  the 
difference  between  the  two  Independent  statements  TIL  a  UL^  and 
yi/3i(llL  )  a  y//^(11L  ). 

s  0 

The  elementary  p  maJces  this  example  a  candidate  for  the  use  of  e 

d 

as  the  transfer  function  of  a  linear  operator  which  normalizes  L  to 

S 

have  the  sajne  noise  power  spectral  density  as  L^,  as  was  mentioned  at 
(29),  Let  S  denote  this  linear  operator.  Then,  proceeding  exactly  as 

d 

for  (37) 

yA^K(U®  L  ) 

d  s 

y^3i(UL  ) 

0 

II 1/2 

M,ll, 

For  the  cases  considered  this  is  approximately  unity  except  for  near 
the  zero  set  of  The  significance  of  (38)  is  that  it  is  an  explicit 

example  of  Observations  1  and  2:  on  L  is  at  least  as  good  as  L^ 
with  the  additional  feature  of  extended  frequency  response  outside  of 
That  is,  on  there  is  no  penalty  for  the  additional  response 
outside  of  £1^.  On  the  other  hand,  (38)  only  gives  essentially 
equivalent  performance  on  £2^,  despite  the  fact  that  has  no  zeroes. 


e  (w  ) 

d  0 

Vm |p^ (w^) 


u  e  £2 
0  1 
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Once  again,  any  advantage  due  to  this  later  depends  on 

(39) 

where  S  is  a  linear  operator  and  ^  its  transfer  function.  It  is 
clearly  possible  for  EL  to  be  the  optimal:  for  example,  consider 

d  s 

$uN  constant  and  6  convex. 

0 

This  consideration  is  of  significance  for  operators  p  ,  p . p 

12  m 

that  are  not  characteristic  functions  of  sets  but  rather  have  each  p 
approximately  compactly  supported.  The  primary  example  here  is  the 
diffraction  limited  lens.  If  strongly  coprime  convolvers  p  ,  p . p 

12  m 

were  such  that  each  was  small  outside  some  set,  then  the  envelope 

transfer  function  would  exhibit  the  same  behavior.  In  this  case, 

unless  sup  )  is  substantially  greater  than  ),  the 

S 

performance  of  the  strongly  coprime  configuration  will  be  essentially 
that  of  its  constituent  convolvers. 


L  )  II  ^  u  N  I 

sup  -  =  sup  - 

»  L  )  t  $  u  t  N 

d  s  0 

6(w  ) 

0 
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4.4  More  comparisons:  strongly  coprime  versus  change  of  scale 

Let  L  be  the  same  as  above.  In  the  above  L  was  compared  with 

s  S 

2  2 

L^,  where  was  chosen  to  be  and  these  cases 

was  the  "best"  In  the  sense  £1,  c  fl  i=l,2,...,m  .  Here  L  will  be 

11  s 

compared  with  a  one  parameter  family  of  such  L.  Define  by  the 
trivial  configuration  of  m  parallel,  identical  in  (10),  where 

The  primary  result  of  this  section  is 


OBSERVATION 

FOR  FIXED 

NUMBER  OF  CHANNELS: 

Fix 

the  number 

of 

parallel  convolvers  in  both 

L  and 

s 

L 

A 

to  be  m  . 

Let  the 

convolvers 

be 

characteristic  functions  of 

cubes 

on 

r"  amd  let 

the  additive  noise 

be 

as  above . 

Assume 

that 

U 

is  such 

that 

supp(u) 

c 

m  r 

U  -lu  €  R"  : 

j  =  i  ^  ‘ 

=  0,  i?sj|  . 

Then 

for 

n  a  2 

UL  £  UL  for  all  0  <  4  s  1  .  (40) 

S  4 


COROLLARY  TO  OBSERVATION:  For  the  conditions  in  the  Observation 

above,  it  is  advantageous  to  construct  L  using  sets  that  are  as  large 

8 

as  possible. 

APPLICATION  OF  THE  COROLLARY:  In  parallel  scanned  imaging  systems 
with  square  detectors  wherein  the  systems  are  ranked  using  some  U 
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meeting  the  conditions  of  the  Observation  (e.g. ,  horizontal  or  vertical 
bars),  the  detector  size  should  be  sufficiently  large  so  that  the  array 
of  detectors  fills  the  image,  and  the  detector  sizes  in  the  array 
should  constitute  a  strongly  coprime  collection.  (This  application 
depends  on  sufficiently  high  sampling  rates.  See  Chapter  3. ) 


o 


Fig.  21.  (R  :  abscissa  =  u  -axis  solid:  e  ;  broken: 
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Figures  22  and  23  show  two  counterexamples  for  cases  not  addressed 

2 

in  the  Observation.  Figure  22  is  for  the  case  of  the  diagonal  in  K  , 

and  Figure  23  is  for  n  =  1.  The  Observation  fails  on  the  diagonal 

2)  =  -|u=((<)  ,u>  )  €lR^  :  w=w  V  because 
^12  ^ 

^  C|«|-^  .  (42) 

It  fails  for  IR  because  (41)  holds. 

If  in  place  of  characteristic  functions  of  cubes  one  uses 

2 

characteristic  functions  of  disks  on  R  ,  then  the  relationship  between 


e  and  Via 

d 


—  is  intermediate  between  that  of  the  w  -axis  and 
1/2  j 


that  of  the  diagonal  for 


e  (w)  ^  (43) 

The  significance  of  the  Observation  (40)  is  that  it  provides  a 
qualitative  lower  bound  for  the  performance  of  the  strongly  coprime 

configuration.  To  the  extent  performance  is  characterized  for  the  UL  , 

■a. 

the  "envelope"  consisting  of  the  collection  over  all  a.  is  a  lower  bound 
for  the  performance  of  UL  . 

S 

All  of  the  above  has  focused  on  performance  away  from  the  origin. 
If  the  figures  are  rescaled  so  that  the  appear  fixed  with  a 

sequence  of  L  constructed  from  convolvers  of  increasing  support,  the 

S 

Observation  indicates  that  nothing  is  sacrificed  away  from  zero  while 
the  envelope  transfer  function  near  zero  is  substantially  increased. 
That  is,  UL  2:  UL  represents  a  substantial  enhancement  near  w  =  0,  not 

S  ^ 

merely  approximately  identical  performance.  On  the  other  hand,  this 
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xmiform  improvement  is  for  the  case  of  11  supported  by  the  axes.  For 
the  cases  off  the  axes  for  cubes  and  for  the  case  of  disks  there  is  a 
trade-off  between  some  loss  away  from  zero  and  the  gain  near  zero. 
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